Would you like to switch to Go

Data Engineering & Delivery

Lead Data Engineer

Team: Delivery
Positions open: 1
Experience required: 7 years to 9 years
Location: Bangalore
Job Type: Fulltime
Last Updated: 7th Nov, 2022

Apply Now

About us

Powered by AI, DataWeave provides Competitive Intelligence as a Service to retailers and consumer brands by aggregating and analyzing data from the Web at massive scale. While retailers use DataWeave’s Retail Intelligence product to make smarter pricing, assortment, and promotion decisions to drive profitable growth, consumer brands use DataWeave’s Brand Analytics product to govern their online brand presence, optimize their Share of Voice, and drive improved e-commerce shelf velocity. DataWeave’s Counterfeit Products Detection Solution was awarded as one of the “Best 50 Innovative Applications of Artificial Intelligence” by NASSCOM in 2018. Also, our competitive intelligence platform won the NASSCOM Emerge 50 Award in 2016. Some of the world’s largest and most popular retailers and brands have consistently trusted DataWeave, including the likes of Overstock, Metro Cash & Carry, OfferUp, Adidas, Dorel, and Netgear.

Data Engineering and Delivery @DataWeave

We the Delivery / Data engineering team at DataWeave, deliver the Intelligence with actionable data to the customer. One part of the work is to write effective crawler bots to collect data over the web, which calls for reverse engineering and writing scalable python code. Other part of the job is to crunch data with our big data stack / pipeline. Underpinnings are: Tooling, domain awareness, fast paced delivery, and pushing the envelope.

As a data analytics company, we bring more power to our customers' fingertips through unmatched access to key and relevant competitive insights that drive strategic decision-making. Our customers have increased their top line by up to 40% and their bottom line by up to 3X by using our competitive intelligence platform. While conventional competitive intelligence systems are still mostly limited to providing descriptive insights, DataWeave’s product suite delivers prescriptive insights, enabling instant actions and solutions to clearly defined and actionable business problems at scale.

Jump aboard the innovation wagon today! Embrace the cutting edge in data science and engineering to devise novel solutions to unique problems in the world of retail. Read more at https://dataweave.com/in/careers

How we work?

It's hard to tell what we love more, problems or solutions! Every day, we choose to address some of the hardest data problems that there are. We are in the business of making sense of messy public data on the web. At serious scale! Read more on Become a DataWeaver

What do we offer?

  • Some of the most challenging data problems. Huge text and image datasets that you can play with!
  • Ability to see the impact of your work and the value you're adding to our customers almost immediately.
  • Opportunity to work on different problems and explore a wide variety of tools to figure out what really excites you. A culture of openness. Fun work environment. A flat hierarchy. Organization wide visibility. Flexible working hours.
  • Learning opportunities with courses and tech conferences. Mentorship from seniors in the team.
  • Last but not the least, competitive salary packages and fast paced growth opportunities

Relevant set of skills

  • Good communication and collaboration skills with 6+ years of experience.
  • Ability to code and script with strong grasp of CS fundamentals, excellent problem solving abilities.
  • Comfort with frequent, incremental code testing and deployment, Data management skills
  • Experience in working with Data pipelines and processing large datasets.
  • Knowledge of building crawlers and data mining is a plus.
  • Working knowledge of open source tools such as mysql, Solr, ElasticSearch, Cassandra (data stores) would be a plus.
  • Expert in Python programming
  • Prior experience of working in data analytics domain
  • Design modules, tools which solves specific technical problem

Role and responsibilities

  • Inclined towards working in a start-up environment.
  • Comfort with frequent, incremental code testing and deployment, Data management skills
  • Design and Build robust and scalable data engineering solutions for structured and unstructured data for delivering business insights, reporting and analytics.
  • Expertise in troubleshooting, debugging, data completeness and quality issues and scaling overall system performance.
  • Build robust API’s that powers our delivery points (Dashboards, Visualizations and other integrations).
  • Be technical “go-to” for a team of engineering
  • Ability to handle multiple deliverables / delegate / mentor junior team members
  • Work with Delivery Managers closely to give the technical visibility for the projects.
  • Setting best practices and coding standards for the tea

Book a Demo

  Tick this box to subscribe to our quarterly newsletter