ROXIE crashing while loading workunits that refer to python2, if python3 selected

Environment

CentOS 7; bare-metal config; single-node HPCC system; python 3.6 installed

Description

This is from DataSeers. The problem is likely not specific to ROXIE but that is where the problem is manifesting itself.

With confirmed valid environment.conf settings (additionalPlugins=python3), the right config directory cited in environment.xml (/etc/HPCCSystems), and a working python3 environment (tested from the command line as the hpcc user), ROXIE crashes on start with the following trace:

Note that ROXIE loaded /opt/HPCCSystems/versioned/python2/libpy2embed.so, which his almost certainly the cause of the crash. Why did it pick up that library when environment.conf has the additionalPlugins=python3 setting?

Conclusion

None

Attachments

1

Activity

Show:

Richard Chapman July 23, 2020 at 10:49 AM

It would be better if it didn't crash in such cases - so I'll leave the issue open in case I can think of some way to improve that.

Dan Camper July 22, 2020 at 9:46 PM

It turned out that not all queries were unpublished, and at least one of them imported python. This issue can be closed. Thanks, Richard!

Dan Camper July 22, 2020 at 5:20 PM

Supposedly all queries had been unpublished, but I will reconfirm.

Richard Chapman July 22, 2020 at 4:17 PM

It looks like it has finished preloading the plugins, and is now loading queries. My guess is that one of the queries being loaded was linked against python2?

Dan Camper July 22, 2020 at 4:10 PM

Log attach. I've requested copies of environment.conf and environment.xml and will attach when I get them.

Fixed
Pinned fields
Click on the next to a field label to start pinning.

Details

Components

Assignee

Reporter

Priority

Fix versions

Pull Request URL

Affects versions

Created July 22, 2020 at 3:28 PM
Updated July 24, 2020 at 12:45 PM
Resolved July 24, 2020 at 12:45 PM