Solved

How to set up environment for Python in cron?

Posted on 2010-11-09
6
1,163 Views
Last Modified: 2012-05-10
I have a Python script that runs fine standalone. When I add it to the cron on a Solaris, it fails. From the output log, the problem is it cannot find the PATH and LID_LIBRARY_PATH of the executable embedded in the Python. My question is how to set this up? Should this be done in the Python or in the cron? I have tried various ways without success. Here are two examples:

02 * * * * /home/<user>/test.py input1 > /tmp/test.log 2>&1
02 * * * * SHELL=/usr/bin/bash; export SHELL; . $HOME/.profile_user; /home/<user>/test.py input1 > /tmp/test.log 2>&1

Basically the Python runs with one input parameter. In the Python script, it calls a 3rd party executable. I see two env variable scripts I need to run - one is the .profile_user and another one is the app specific env.

Many thanks!
0
Comment
Question by:eduliu
  • 3
  • 2
6 Comments
 
LVL 68

Expert Comment

by:woolmilkporc
ID: 34096937
Simplest way would be running the script from root's crontab as the "normal" user with "su -", so that the full environment of that user will be initialized.

02 * * * * su - normal_user -c "/home/<user>/test.py input1 > /tmp/test.log 2>&1"

wmp
0
 

Author Comment

by:eduliu
ID: 34097024
I just tried, but it didn't work - it didn't run. I guess it's becuase I'm not running cron as root. The account I use can create cron but under my account I assume. Any other way to insert a couple of scripts to set up the environment? Thanks!
0
 
LVL 16

Expert Comment

by:gelonida
ID: 34100058
if you want to call 3rd party executables, then it is enough to set the PATH variable from within python before you call your executable.


Alternatively you can create a wrapper shell script setting up the env before calling your python script.

import os
os.environ['PATH'] = 'newpath:' + os.environ['PATH']
os.environ['LD_LIBRARY_PATH'] = 'newpath:' + os.environ['LD_LIBRARY_PATH']
0
Is Your Active Directory as Secure as You Think?

More than 75% of all records are compromised because of the loss or theft of a privileged credential. Experts have been exploring Active Directory infrastructure to identify key threats and establish best practices for keeping data safe. Attend this month’s webinar to learn more.

 
LVL 16

Expert Comment

by:gelonida
ID: 34100068
the wrapper script solution would be:

#!/bin/sh
export PATH="newpath:$PATH"
export LD_LIBRARY_PATH="newpath:$LD_LIBRARY_PATH"

mypythonscript "$@"


0
 
LVL 16

Accepted Solution

by:
gelonida earned 500 total points
ID: 34100091
Third way is to set the vars directly in the crontab entry:


PATH=/usr/bin:mypath LD_LIBRARY_PATH=/usr/bin:mypath  /home/<user>/test.py input1


Please note.
no semicolons and no export statementments.

In all three cases you must be sure to add ALL required directories and all required environment variables, that are needed
for your third party executable to be run.
As I don't knowit you might have to experiment
0
 

Author Comment

by:eduliu
ID: 34102669
Thank you so much for the detailed and various options. Quite embarrassing, the cause was one variable in one of the env scripts had a value assigned wrong. Things are working now. Appreciate the help!
0

Featured Post

Is Your Active Directory as Secure as You Think?

More than 75% of all records are compromised because of the loss or theft of a privileged credential. Experts have been exploring Active Directory infrastructure to identify key threats and establish best practices for keeping data safe. Attend this month’s webinar to learn more.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Strings in Python are the set of characters that, once defined, cannot be changed by any other method like replace. Even if we use the replace method it still does not modify the original string that we use, but just copies the string and then modif…
Dictionaries contain key:value pairs. Which means a collection of tuples with an attribute name and an assigned value to it. The semicolon present in between each key and values and attribute with values are delimited with a comma.  In python we can…
Learn how to find files with the shell using the find and locate commands. Use locate to find a needle in a haystack.: With locate, check if the file still exists.: Use find to get the actual location of the file.:
In a previous video, we went over how to export a DynamoDB table into Amazon S3.  In this video, we show how to load the export from S3 into a DynamoDB table.

896 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

13 Experts available now in Live!

Get 1:1 Help Now