proc is a virtual file system so I wouldn't rely on any file status information.
The start time of the process is located at /proc/PID/stat column 22. It is given in jiffies after system boot. To convert it to seconds you have to divide it by sysconf(_SC_CLK_TCK) which is 100 for most systems (but not all!).
To get the time of system boot you determine the current uptime in seconds which is the first value of /proc/uptime.
Having those two numbers you subtract the first from the second and you get the number of seconds passed since starting the program.
Example (for pidgin):
PID=$(pidof pidgin)
STARTTIME=$(awk '{print int($22 / 100)}' /proc/$PID/stat)
UPTIME=$(awk '{print int($1)}' /proc/uptime)
NOW=$(date +%s)
DIFF=$((NOW - (UPTIME - STARTTIME)))
date -d @$DIFF
Note: this simple example doesn't work if pidof returns multipe PIDs.