Data Engineer / BI Developer – Cloud Data Platform at DS Technologies Inc in NY-New York-10004

Job description

• DS Technologies Inc is looking for Data Engineer / BI Developer – Cloud Data Platform role for one of our premier clients.
• We are seeking a highly skilled Data Engineer / BI Developer to join our Cloud Data Platform Managed Services team. The ideal candidate will possess strong technical expertise in PySpark, SQL, and data visualization, with hands-on experience in tools such as Retool and Power BI. This role requires a mix of backend data engineering and frontend dashboard development skills to design, build, and maintain scalable data pipelines and analytical solutions.

Responsibilities

• Design, develop, and optimize ETL/ELT data pipelines using PySpark, SQL, and cloud-native services.
• Develop interactive and dynamic dashboards and visualizations using Retool or Power BI to support business analytics and reporting needs.
• Collaborate with data scientists, analysts, and business stakeholders to translate requirements into scalable data models and reports.
• Integrate data from multiple sources (structured and unstructured) into unified datasets for analysis and visualization.
• Implement and manage data transformation workflows, ensuring accuracy, performance, and compliance with data governance standards.
• Participate in infrastructure management for the Cloud Data Platform, focusing on data accessibility, reliability, and scalability.
• Work closely with cross-functional teams to ensure end-to-end data integrity and performance tuning.
• Apply software engineering best practices such as version control, testing, and CI/CD in data pipeline development.

Requirements

• PySpark | SQL | Python | Java | Retool | Power BI | Cloud Data Platforms | ETL/ELT | Dashboarding | Front-End Design | Data Modeling | Data Visualization
• 5+ years of hands-on experience in Data Engineering and Business Intelligence development.
• Strong expertise in PySpark and advanced SQL coding for complex data transformations.
• Experience with Retool (preferred) and/or Power BI for dashboard development.
• Proficiency in Python and Java for data processing and integration.
• Understanding of front-end web design principles to build user-friendly data interfaces.
• Experience working with cloud data platforms (AWS, Azure, or GCP)
• Strong analytical and problem-solving skills with an eye for data quality and accuracy.
• Self-starter with the ability to define requirements, design solutions, and execute independently.
• Excellent communication and collaboration skills with cross-functional stakeholders.
• Experience with data warehouse modeling and performance tuning.
• Familiarity with data governance, security standards, and metadata management.
• Exposure to data visualization libraries (e.g., D3.js, Plotly) is a plus.
• Bachelor’s or master’s degree in computer science, Data Engineering, or a related field.

Skills

Required

• PySpark
• SQL
• Python
• Java
• Retool
• Power BI
• ETL/ELT
• Dashboarding
• Front-End Design
• Data Modeling
• Data Visualization

Preferred

• Data warehouse modeling
• Performance tuning
• Data governance
• Security standards
• Metadata management
• D3.js
• Plotly

Benefits

• Compensation: $52.00 per hour