We're looking for a professional Big Data Engineer to help us build and maintain our Big Data solutions. In this role, you may be asked to design and implement Big Data tools and frameworks, implement ELT procedures, coordinate with development teams, set up cloud platforms, and maintain the assembly system.
Hadoop Systems Development.
After loading various data sets, use Hive or Pig to perform pre-processing activities.
complete system scope and provide Big Data solutions to govern the exchange of information between the internal system and the survey vendor
Collaborate with software research and development teams
Create cloud platforms for commercial application implementation.
Train staff in data resource management.
Bachelor's degree in computer science or engineering.
Previous experience as a massive data engineer.
In-depth knowledge of Hadoop, Spark, and other related frameworks.
Knowledge of scripting languages such as Java, C++, Linux, Ruby, PHP, Python, and R is required.
Knowledge of Mesos, AWS, and Docker tools.
Help solve difficult data, software, and networking problems.