Position Summary
As a Data Engineer, you will play a pivotal role in developing and integrating advanced technological solutions to enhance our Manufactured Housing platform. You will be instrumental in building data pipelines, data platform, APIs, automating processes, integrating third-party platforms, and support creating dynamic, user-friendly web experiences. Your expertise will also help bridge our HubSpot website with our Roots Data Platform, automating ad postings, and developing comprehensive reporting dashboards.
RESPONSIBILITIES
- Responsible for implementing a robust data estate using Microsoft Azure Stack, create reusable and scalable data pipelines, developing & deploying data platforms
- API Development and Integration: Build and maintain APIs that connect our HubSpot website to the Roots Data Platform, enabling dynamic listing of home and community information in a Zillow-like experience.
- Collaborate with application development team to provide submitted photos, branded assets, and marketing templates to listing platform via APIs.
- Build data pipelines to develop and deploy data platform, to enable insightful reporting and dashboards, focusing on key metrics such as Leads, Calls, Appointments, and Applications from HubSpot data as well as other data sources.
- CRM Integration: Develop integrations between various third-party ad listing platforms (Zillow, ShowMojo, MH Village, MHBO, etc.) and our HubSpot CRM to track every lead efficiently.
- Collaborate with web developer(s) by aiding in building custom website features like advanced home and community search tools, payment calculators, EYR calculators, etc., providing custom web experiences and enhancing user engagement.
- Responsible for getting UAT and Go Live for Data platform projects.
QUALIFICATIONS
- Bachelor’s degree in computer science, Information Technology, or a related field.
- Minimum of 3 years of experience in data warehousing with Big Data or cloud, data pipeline development, API integration.
- Experience in working on Azure Services like Azure Data Factory, Azure Function, Azure SQL, Azure Data Bricks, Azure Data Lake, Synapse Analytics
- Proficiency in SQL and experience with big data technologies such as Spark, and NoSQL databases. Expertise in data modeling, data warehousing, and ETL processes
- Proficiency in modern programming languages (Python,PySpark) and frameworks. Indepth knowledge of Spark, including Spark SQL, DataFrames, Datasets, RDDs (Resilient Distributed Datasets), and Spark Streaming, is crucial.
- Experience of working in Agile delivery model
- Experience with CRM systems and HubSpot experience is a huge plus.
- Knowledge of Big Data technologies, such as Spark, Hadoop/MapReduce is a plus.
- Familiarity with various data storage options and formats (e.g., Parquet, Avro, JSON)
- Understanding of CI/CD (Continuous Integration/Continuous Deployment) practices for data pipelines, including version control, testing, and deployment strategies using Azure DevOps or similar tools.
- Excellent communication and collaboration; being able to work effectively across multiple departments on projects that impact the whole company.
