Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

YmNwQnUxM3lKZ0gxNXdadlVxWndsU3VodWc9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

Davis & Shirtliff Tanzania

IT Attache Job at Davis & Shirtliff Tanzania

Find out how you can apply for a vacancy, industrial attachment or internship at Davis & Shirtliff.As part of its #ImprovingLives CSR activities, Davis & Shirtliff offers training attachment to deserving students in institutions of higher learning. Every year, however... 

Die-Mension Corporation

Wire EDM Set Up / Operator Job at Die-Mension Corporation

 ...as needed. Loads and edits CNC programs as needed Utilizes knowledge of linear axes and using G and M codes Programming, operating and maintaining Wire EDM utilizing knowledge of working properties and processes for a variety of materials Verifies conformance... 

ATC

Information Technology Help Desk Analyst Job at ATC

 ...Information Technology Help Desk Analyst 2 Fully Onsite Position at Chester, PA 1 year contract with multi-year extensions Hourly...  ...to end users for hardware, software, and systems. Provides hands-on technical assistance to business and technical users. Investigates... 

Aerotek

Warehouse Person I (2nd Shift) Job at Aerotek

Job Title: Warehouse WorkerJob DescriptionJoin a dynamic team where you will be involved in picking and filling orders within a fast...  ...of the business, which encompasses receiving, housing, picking, packing, and shipping products from various locations to distribution... 

PNC Financial Services Group, Inc.

Capital Markets Sr. Associate - Sales Derivative Products Group (FINRA) Job at PNC Financial Services Group, Inc.

 ..., the Secure and Fair Enforcement for Mortgage Licensing Act of 2008 (SAFE Act) and/or the Financial Industry Regulatory Authority (FINRA), which prohibit the hiring of individuals with certain criminal history. California Residents Refer to the California Consumer...