Data Engineer – Azure Databricks at High Bridge Consulting LLC in NY-New York-10017
- Company: High Bridge Consulting LLC
- Location: NY-New York-10017
- Posted: Sep 18, 2026
- Type: Full-time
- Salary: $70.00 - $90.00 per hour
- Experience: 5+ years
Overview
We are hiring a Data Engineer with strong Azure Databricks and Azure Data Engineering experience to build and scale enterprise data pipelines across corporate functions including Finance, Compliance, Facilities, RESO, and HCG.
Job description
- We are hiring a Data Engineer with strong Azure Databricks and Azure Data Engineering experience to build and scale enterprise data pipelines across corporate functions including Finance, Compliance, Facilities, RESO, and HCG.
- This role focuses on modern cloud data engineering, ETL/ELT pipelines, and enterprise system integration within a large-scale Azure data ecosystem.
- NYC area (Hybrid – 3 days onsite per week)
- High-impact enterprise data platform work
- Exposure across multiple business domains
- Opportunity to shape modern Azure Databricks architecture
- Strong focus on scalability, engineering excellence, and innovation
Responsibilities
- Design, build, and maintain Azure Databricks + Azure Data Factory pipelines
- Develop ETL/ELT workflows for structured and unstructured data
- Build scalable data models and lakehouse architectures
- Integrate enterprise systems (ServiceNow, Workday, Dataverse, APIs)
- Optimize SQL queries, Spark jobs, and data processing performance
- Ensure data governance, security, and data quality standards
- Support monitoring, troubleshooting, and pipeline reliability
- Collaborate across business and technical teams
Requirements
- 5+ years in Data Engineering / Cloud Data Engineering
- Strong hands-on experience with Azure, Databricks, Spark
- Advanced SQL and large-scale data processing
- Experience with Azure Data Factory
- Strong programming in Python or Scala
- Experience with Azure SQL Database
- Familiarity with APIs, event-driven architecture, and system integration
- Experience with Azure Functions
- Working knowledge of C# and/or PowerShell
- Strong communication and stakeholder management skills
- Delta Lake / Lakehouse architecture
- Azure DevOps / CI-CD pipelines
- Data governance / catalog tools (e.g., Purview)
- Agile/Scrum environment experience
- Microsoft or Databricks certifications
Skills
Required
- Azure Databricks
- Azure Data Factory
- Spark
- Advanced SQL
- Python or Scala
- Azure SQL Database
- APIs
- Event-driven architecture
- System integration
- Azure Functions
- C# and/or PowerShell
- Strong communication
Preferred
- Delta Lake / Lakehouse architecture
- Azure DevOps / CI-CD pipelines
- Agile/Scrum environment experience
- Microsoft or Databricks certifications
Benefits
- Compensation: $70.00 - $90.00 per hour
About High Bridge Consulting LLC
High Bridge is a bottom-up consulting firm with more than two decades of experience creating innovative solutions for the technology industry. • We connect thoughtfully curated talent with reputable employers in our field. • We partner with like-minded companies to bolster mutual success and understanding. • We deliver results through strategic planning and meticulous project management. At High Bridge, we believe that success is a measure of results and process, product and person. We are proud to bring integrity and humanity to the work that we do each day. Whether we’re interviewing prospective associates, brainstorming with partners, or troubleshooting with vendors, we pledge our commitment to honesty, transparency, and good humor at every junction.