$135.00 - $150.00 Posted:
Job Description
Get AI-powered advice on this job and more exclusive features.
Direct message the job poster from Tekshapers
Responsibilities
- Design high quality deliverables adhering to business requirements with defined standards and design principles, patterns
- Develop and maintain highly scalable, high performance Data transformation applications using Apache Spark framework
- Develop/Integrate the code adhering to CI/CD, using Spark Framework in Scala/Java
- Provide solutions to big data problems dealing with huge volumes of data using Spark based data transformation solutions, Hive, MPP processes like IMPALA
- Create Junit tests and ensure code coverage is met as per the agreed standards
- Should be able to work with a team who might be geographically distributed. Review the code modules developed by other juniors.
Required Skill Sets
- Must-Have Hands on development experience in programming languages such as JAVA, SCALA using Maven, Apache Spark Frameworks and Unix Shell scripting
- Should be comfortable with Unix File system as well as HDFS commands
- Should have worked on query languages such as Oracle SQL, Hive SQL, Spark SQL, Impala, HBase DB
- Should be flexible
- Should have good communication and customer management skills
Desired Skill Sets
- Good-to-Have Should have knowledge on Big data Data Ingestion tools such as SQOOP and KAFKA.
- Should be aware of the components in Big Data ecosystem.
- Should have worked on building projects using Eclipse IDE, Tectia Client, Oracle SQL Developer.
Seniority level
Mid-Senior level
Employment type
Full-time
Job function
Information Technology
Industries
IT Services and IT Consulting
Referrals increase your chances of interviewing at Tekshapers by 2x
Data Engineer, Corporate Data and Analytics
Toronto, Ontario, Canada $135.00-$150.00 4 weeks ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr