Senior Data Engineer
About DataWeave
Powered by AI, DataWeave provides Competitive Intelligence as a Service to retailers and consumer brands by aggregating and analyzing data from the Web at massive scale.
While retailers use DataWeave’s Retail Intelligence product to make smarter pricing, assortment, and promotion decisions to drive profitable growth, consumer brands use DataWeave’s Brand Analytics product to govern their online brand presence, optimize their Share of Voice, and drive improved e-commerce shelf velocity. DataWeave’s Counterfeit Products Detection Solution was awarded as one of the “Best 50 Innovative Applications of Artificial Intelligence” by NASSCOM in 2018. Also, our competitive intelligence platform won the NASSCOM Emerge 50 Award in 2016.
Some of the world’s largest and most popular retailers and brands have consistently trusted DataWeave, including the likes of Overstock, Metro Cash & Carry, OfferUp, Adidas, Dorel, and Netgear.
Data Engineering @DataWeave
We the Delivery / Data engineering team at DataWeave, deliver the Intelligence with actionable data to the customer. One part of the work is to write effective crawler bots to collect data over the web, which calls for reverse engineering and writing scalable python code. Other part of the job is to crunch data with our big data stack / pipeline. Underpinnings are: Tooling, domain awareness, fast paced delivery, and pushing the envelope
What do we offer?
We the Delivery / Data engineering team at DataWeave, deliver the Intelligence with actionable data to the customer. One part of the work is to write effective crawler bots to collect data over the web, which calls for reverse engineering and writing scalable python code. Other part of the job is to crunch data with our big data stack / pipeline. Underpinnings are: Tooling, domain awareness, fast paced delivery, and pushing the envelope
Roles & Responsibilities
- Inclined towards working in a start-up environment.
- Comfort with frequent, incremental code testing and deployment, Data management skills
- Design and Build robust and scalable data engineering solutions for structured and unstructured data for delivering business insights, reporting and analytics.
- Expertise in troubleshooting, debugging, data completeness and quality issues and scaling overall system performance.
- Build robust API ’s that powers our delivery points (Dashboards, Visualizations and other integrations).
Skills & Requirements
- Good communication and collaboration skills with 4-7 years of experience.
- Ability to code and script with strong grasp of CS fundamentals, excellent problem solving abilities.
- Comfort with frequent, incremental code testing and deployment, Data management skills
- Good understanding of RDBMS
- Experience in building Data pipelines and processing large datasets .
- Knowledge of building crawlers and data mining is a plus.
- Working knowledge of open source tools such as mysql, Solr, ElasticSearch, Cassandra ( data stores ) would be a plus.
- Expert in Python programming
Job Location:
Bangalore, India
Address:
InfoWeave Analytics Pvt Ltd,
3rd Floor, Brigade Software Park
Banashankari Stage II, Basavanagudi,
Bengaluru 560070
+(91) 80 42 08 1302
contact@dataweave.com