Hadoop Platform Engineer Job at RAMPS International Inc., San Jose, CA

YThsSHZsMzhKQWYxNVFGdlVxUjdsaTZqdVE9PQ==
  • RAMPS International Inc.
  • San Jose, CA

Job Description

Job Description

Job Description

Hadoop Platform Engineer
San Jose, CA
4-12 Months

Position summary
The Data and Analytics Platform team resides within Adobe's Information and Data Services team and we are looking for a Hadoop Platform Engineer who will be responsible for the implementation and ongoing administration of Hadoop infrastructure including designing, deploying, monitoring, tuning and troubleshooting.

Job Responsibilities
Responsibilities:
• Design and develop different architectural models for our scalable data processing as well as scalable data storage
• Build data pipelines and ETL using heterogeneous sources
• Build data ingestion from various source systems to Hadoop using Kafka, Flume, Sqoop, Spark Streaming etc.
• Transform data using data mapping and data processing capabilities like MapReduce, Spark SQL
• Supports Big Data and batch/real time analytical solutions
• Own the platform architecture and drive it to the next level of effectiveness to support current and future requirements
• Design, implement, deploy and maintain security, data capacity, node forecasting and planning.
• Provide hardware architectural guidance, plan and estimate cluster capacity, and create roadmaps for the Hadoop cluster deployment.
• Closely work with the Hadoop development, infrastructure, network, database, and business intelligence teams.
• Participate in a 12x7 rotation for production issue escalations.
• Communicate effectively with people at all levels of the organization.

Requirements:
• B.S. degree in Computer Science, Electrical and Computer Engineering, or equivalent technical fields.
• Experience in tools integration, automation, configuration management systems.
• Experience with networking, systems administration skills.
• 3+ years of hands on working experience on Hadoop infrastructure stack (Ex: HDFS, MapReduce, HBase, Flume, Spark, Pig, Hive, Oozie, YARN, Zookeeper, Presto, etc). 2+ years of experience in Python or Perl.
• MapReduce, Hbase, Hive, Impala, Spark, Kafka, Kudu, Solr)
• Strong development/automation skills. Must be very comfortable with reading and writing Scala, Python or Java code.
• Proven Ability to build Curated Models for BI and Analytics
• Strong SQL Skills

Best regards,

 
Sridhar P
Senior Recruiter | RAMPS International, Inc
1199 Amboy Ave, Suite 2F, Edison, NJ 08837
email: sridhar@rampscorp.com |url:

Job Tags

Work experience placement,

Similar Jobs

QUANTEAM - North America (RAINBOW PARTNERS Group)

AML & BSA Senior Consultant Job at QUANTEAM - North America (RAINBOW PARTNERS Group)

 ...collaborates across 10 international offices: Paris, Lyon, New York, Montreal, London, Brussels, Geneva, Lisbon, Porto and Casablanca. The AML/Sanctions Consultant is responsible for analyzing anti-money laundering (AML) and sanctions-related alerts to ensure compliance with... 

Kerry

Senior Scientist - Meat /Seasoning Job at Kerry

 ...Learn and assist in the upscaling process. Utilize your meat science capability and culinary flair to test your formulations in simple...  ...testing its own products! Qualifications: BS/MS in Food Science or related field. Ideally at least 4 years food industry... 

CHRISTUS Health

Clinical Laboratory Scientist II-Lab AdminGeneral-PRN Job at CHRISTUS Health

 ...served. Demonstrates adherence to the CORE values of CHRISTUS Health. Must complete all required compliance and regulatory tasks...  ...in a chemical, physical, biological or clinical laboratory science or medical technology from an accredited institution or equivalent... 

System7, Inc.

Controls Engineer Job at System7, Inc.

 ...programming, developing and maintaining a broad range of electrical/electronic and mechanical systems or components by focusing on safety,...  ... Fabricate mechanical, electrical, and electronic works and assemblies. Work condition of a Controls Engineer Work may be... 

WorkSource Oregon

Tow Truck Dispatcher (Clerical) Job at WorkSource Oregon

 ... account is required prior to referral to the employer. Immediate Need! A towing and salvage company in Woodburn, Oregon, is...  ...Requirements: - Eighteen (18) years of age or older - No experience necessary this employer is willing to train qualified applicants...