python - Airflow HiveOperator not working -


i trying use hive operator in airflow. have dependencies installed (pyhs2, pyhive, , ran pip install airflow[hive]).

however when use code below

t1 = hiveoperator(     task_id='simple_query',     hql='select * cities',     dag=dag) 

i error. not sure means

[2016-01-06 03:26:39,500] {models.py:1017} error - [errno 2] no such file or directory traceback (most recent call last):   file "/usr/local/lib/python2.7/dist-packages/airflow/models.py", line 977, in run     result = task_copy.execute(context=context)   file "/usr/local/lib/python2.7/dist-packages/airflow/operators/hive_operator.py", line 65, in execute     self.hook.run_cli(hql=self.hql, schema=self.schema)   file "/usr/local/lib/python2.7/dist-packages/airflow/hooks/hive_hooks.py", line 110, in run_cli     cwd=tmp_dir)   file "/usr/lib/python2.7/subprocess.py", line 710, in __init__     errread, errwrite)   file "/usr/lib/python2.7/subprocess.py", line 1327, in _execute_child     raise child_exception oserror: [errno 2] no such file or directory [2016-01-06 03:26:39,512] {models.py:1053} error - [errno 2] no such file or directory 

this error occurs when hive command line interface (cli) isn't available in system path.


Comments

Popular posts from this blog

multithreading - Exception in Application constructor -

React Native allow user to reorder elements in a scrollview list -

windows - CertCreateCertificateContext returns CRYPT_E_ASN1_BADTAG / 8009310b -