Senior Data Engineer - Debt Solutions - San Diego, CA at CoStar Group

Job description

Senior Data Engineer - Debt Solutions - San Diego, CA Job Description CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index, CoStar Group is on a mission to digitize the world’s real estate, empowering all people to discover properties, insights and connections that improve their businesses and lives. We have been living and breathing the world of real estate information and online marketplaces for over 35 years, giving us the perspective to create truly unique and valuable offerings to our customers. We’ve continually refined, transformed and perfected our approach to our business, creating a language that has become standard in our industry, for our customers, and even our competitors. We continue that effort today and are always working to improve and drive innovation. This is how we deliver to our customers, our employees, and investors. By equipping the brightest minds with the best resources available, we provide an invaluable edge in real estate. The Debt Solutions Team is growing quickly, and we’re looking for a Senior Data Engineer to help accelerate our growth. This role will be responsible for helping build out sitewide tracking architecture and then feeding that data into user-friendly KPI dashboards which track site performance and product usage and provide day-to-day insights into consumer behavior. This individual will help build and deliver the data engineering architecture for Debt Solutions and work across all departments to provide analysis and insights for future growth. You will be part of various aspects of our data management, ranging from designing and maintaining automated data infrastructure and delivering Data engineering and Analytics solutions to facilitating data access and analysis for key company teams. Our team in San Diego plays a key role in the development of these industry-leading products. We’re a full-stack product development organization, with front end, back end, data and machine learning engineering roles, building great products with modern tools and technology. This position is located in San Diego, CA and offers a schedule of Monday to Thursday in the office and work from home o n Fridays. Responsibilities: Design and Oversee implementation of dimensional modeling, database design, and cloud data platform structures (e.g., Databricks, Snowflake, BigQuery ) Develop data platform framework to build secure data warehouses and data lakehouses applying principles of Medallion Architecture Design, develop, and maintain scalable data pipelines and ETL processes using Databricks, Snowflake, and other AWS services Implement and optimize Spark jobs, data transformations, and data processing workflows in Databricks Building and deploying AI/ML models: Integrate Machine Learning into data pipelines, leverage Databricks ML and A WS ML to develop predictive models and drive business insights Define and Apply AI-assisted software development practices to improve engineering productivity and code quality Understand various data domains and be able to translate them through data transformations to suit various business needs Oversee automated data infrastructure: Collaborate with software engineering and product teams to streamline data tracking in our products Ability to integrate data from disparate sources via cross domain data stitch into existing data model Implement data governance, lineage tracking, testing, and monitoring frameworks to guarantee data integrity Hands-on data optimization and query performance Liaise with key company teams (DBA, DevOps , SecOps…) for data accessibility and analysis Mentor and manage engineers and analysts in the normal execution of their responsibilities. Successfully implement software development projects to specification and within scheduled timelines and budget parameters Leverage AWS DevOps and CI/CD best practices to automate the d