MPI/python application trace - python

I have an MPI python application and I tried to trace it using intel trace analyzer and collector. I am running my application on a HPC, I tried to get the .stf trace files to be used as input to intel trace analyzer using this link: https://www.intel.com/content/www/us/en/develop/documentation/get-started-with-itac/top/trace-your-mpi-application.html and this command on linux; mpiexec -trace -n 2 python3 ./run.py,
but I am getting the following error:
Error: mpiexec: Error: unknown option "-trace"
When I run only mpiexec -n 2 python3 ./run.py, it works, but when I added the trace option, it doesn't work, ..
Thank you in advance.

Related

Robocorp Visual studio code long path errror

getting error after downloading robocorp, an building the project
WARNING! Long path support failed. Reason: exit status 1.
WARNING! See https://robocorp.com/docs/product-manuals/robocorp-lab/troubleshooting#windows-has-to-have-long-filenames-support-on for more details.
Long paths do not work!
Executing: c:\Users\davisvin\.vscode\extensions\robocorp.robocorp-code-0.40.2\bin\rcc.exe configure longpaths --enable
Error executing: c:\Users\davisvin\.vscode\extensions\robocorp.robocorp-code-0.40.2\bin\rcc.exe configure longpaths --enable
Error code: undefined
Error: error
Stderr: Failure to modify registry: Access is denied.
Executing: C:/Windows/System32/mshta.exe javascript: var shell = new ActiveXObject('shell.application');shell.ShellExecute('c:/Users/davisvin/.vscode/extensions/robocorp.robocorp-code-0.40.2/bin/rcc.exe', 'configure longpaths --enable', '', 'runas', 1);close();
Executing: c:\Users\davisvin\.vscode\extensions\robocorp.robocorp-code-0.40.2\bin\rcc.exe configure longpaths
Error executing: c:\Users\davisvin\.vscode\extensions\robocorp.robocorp-code-0.40.2\bin\rcc.exe configure longpaths
Error code: undefined
Error: error
Stderr: The full path of C:\Users\davisvin\AppData\Local\robocorp\stump\verylongpath1\verylongpath2\verylongpath3\verylongpath4\verylongpath5\verylongpath6\verylongpath7\verylongpath8\verylongpath9\verylongpath10\verylongpath11\verylongpath12\verylongpath13\verylongpath14\verylongpath15\verylongpath16\verylongpath17\verylongpath18\verylongpath19\verylongpath20\verylongpath21\verylongpath22\verylongpath23\verylongpath24 is too long.
WARNING! Long path support failed. Reason: exit status 1.
WARNING! See https://robocorp.com/docs/product-manuals/robocorp-lab/troubleshooting#windows-has-to-have-long-filenames-support-on for more details.
Long paths do not work!
There was some error with rcc configure longpaths.
Windows long paths support NOT enabled.
RCC stdout:
<not collected>
RCC stderr:
<not collected>
Extension will not be activated because Windows long paths support not enabled.
Robocorp Code extension disabled. Reason: Unable to get python to launch language server.
Unable to activate Robocorp Code extension because python executable from RCC environment was not provided.
-- Most common reason is that the environment couldn't be created due to network connectivity issues.
-- Please fix the error and restart VSCode.
Error getting Python
Unable to get language server python info.
Error: Unable to get language server python info.
at c:\Users\davisvin\.vscode\extensions\robocorp.robocorp-code-0.40.2\vscode-client\out\extension.js:92:23
at Generator.next (<anonymous>)
at fulfilled (c:\Users\davisvin\.vscode\extensions\robocorp.robocorp-code-0.40.2\vscode-client\out\extension.js:23:58)
at process.processTicksAndRejections (node:internal/process/task_queues:96:5)
[Error - 2:08:21 PM] Starting client failed
Error: Unable to get language server python info.
at c:\Users\davisvin\.vscode\extensions\robocorp.robocorp-code-0.40.2\vscode-client\out\extension.js:92:23
at Generator.next (<anonymous>)
at fulfilled (c:\Users\davisvin\.vscode\extensions\robocorp.robocorp-code-0.40.2\vscode-client\out\extension.js:23:58)
at process.processTicksAndRejections (node:internal/process/task_queues:96:5)
Error initializing Robocorp code.
Unable to get language server python info.
Error: Unable to get language server python info.
at c:\Users\davisvin\.vscode\extensions\robocorp.robocorp-code-0.40.2\vscode-client\out\extension.js:92:23
at Generator.next (<anonymous>)
at fulfilled (c:\Users\davisvin\.vscode\extensions\robocorp.robocorp-code-0.40.2\vscode-client\out\extension.js:23:58)
at process.processTicksAndRejections (node:internal/process/task_queues:96:5)
Robocorp Code initialization finished. Took: 21.3s
Error resolving interpreter.
command 'robocorp.resolveInterpreter' not found
Error: command 'robocorp.resolveInterpreter' not found
at b.k (vscode-file://vscode-app/c:/Users/davisvin/AppData/Local/Programs/Microsoft%20VS%20Code/resources/app/out/vs/workbench/workbench.desktop.main.js:1669:3069)
at b.executeCommand (vscode-file://vscode-app/c:/Users/davisvin/AppData/Local/Programs/Microsoft%20VS%20Code/resources/app/out/vs/workbench/workbench.desktop.main.js:1669:2985)
at process.processTicksAndRejections (node:internal/process/task_queues:96:5)
Error resolving interpreter.
command 'robocorp.resolveInterpreter' not found
Error: command 'robocorp.resolveInterpreter' not found
at b.k (vscode-file://vscode-app/c:/Users/davisvin/AppData/Local/Programs/Microsoft%20VS%20Code/resources/app/out/vs/workbench/workbench.desktop.main.js:1669:3069)
at b.executeCommand (vscode-file://vscode-app/c:/Users/davisvin/AppData/Local/Programs/Microsoft%20VS%20Code/resources/app/out/vs/workbench/workbench.desktop.main.js:1669:2985)
at process.processTicksAndRejections (node:internal/process/task_queues:96:5)
Error executing: c:\Users\davisvin\.vscode\extensions\robocorp.robocorp-code-0.40.2\bin\rcc.exe feedback metric -t vscode -n vscode.code.error -v ERROR_INITIALIZING_ROBOCORP_CODE_LANG_SERVER
Error code: undefined
Error: error
Stderr: Tracking is disabled. Quitting.
Error executing: c:\Users\davisvin\.vscode\extensions\robocorp.robocorp-code-0.40.2\bin\rcc.exe feedback metric -t vscode -n vscode.code.error -v ACT_RESOLVE_INTERPRETER
Error code: undefined
Error: error
Stderr: Tracking is disabled. Quitting.
Error executing: c:\Users\davisvin\.vscode\extensions\robocorp.robocorp-code-0.40.2\bin\rcc.exe feedback metric -t vscode -n vscode.code.error -v INIT_NO_PYTHON_LANGUAGE_SERVER
Error code: undefined
Error: error
Stderr: Tracking is disabled. Quitting.
Error executing: c:\Users\davisvin\.vscode\extensions\robocorp.robocorp-code-0.40.2\bin\rcc.exe feedback metric -t vscode -n vscode.lsp.error -v EXT_UNABLE_TO_START
Error code: undefined
Error: error
Stderr: Tracking is disabled. Quitting.
Error executing: c:\Users\davisvin\.vscode\extensions\robocorp.robocorp-code-0.40.2\bin\rcc.exe feedback metric -t vscode -n vscode.code.error -v INIT_NO_LONGPATH_SUPPORT
Error code: undefined
Error: error
Stderr: Tracking is disabled. Quitting.
Error executing: c:\Users\davisvin\.vscode\extensions\robocorp.robocorp-code-0.40.2\bin\rcc.exe feedback metric -t vscode -n vscode.code.error -v INIT_PYTHON_ERR
Error code: undefined
Error: error
Stderr: Tracking is disabled. Quitting.
So I manually enabled longs path on powershell, regedit and gpedit windows 10 and I am still getting the same error.
Navigate to Local Computer Policy > Computer Configuration > Administrative Templates > System > Filesystem > NTFS > Enable Win32 long paths
Select Enabled, then click Apply.

How to avoid the make command triggers Xcode

I have a python project that has a makefile which has
test: clean lint
#pytest app/tests/ --cov ./app -s
I usually type make test in the terminal to trigger this pytest. However, recently it stopped working. Instead, I get an error
make: error: sh -c '/Applications/Xcode.app/Contents/Developer/usr/bin/xcodebuild -sdk '' -find make 2> /dev/null' failed with exit code 256: (null) (errno=No such file or directory)
And MacOS pops up a message window saying it needs to download software (without details other than a progress bar). It takes ~10 min to finish installing. But it doesn't change anything. I have installed XCode although I never used it. Pytest still works if I directly type the pytest commands.
My machine is a Macbook Pro with BigSur Intel CPU. I'm not a iOS/MacOS app developer and I don't use Xcode. I don't understand why would make triggers it. How to avoid it?
More info following #MadScientist suggestion:
> type -a make
make is /usr/bin/make
> make --version
OR
> make -d test
xcrun: error: invalid active developer path (/Applications/Xcode.app/Contents/Developer), missing xcrun at: /Applications/Xcode.app/Contents/Developer/usr/bin/xcrun
> /usr/bin/make
xcrun: error: invalid active developer path (/Applications/Xcode.app/Contents/Developer), missing xcrun at: /Applications/Xcode.app/Contents/Developer/usr/bin/xcrun

OSX Catalina - GCC/PIP compilation issue

I'm trying to install a tool on my computer via pip on my Mac and have been having issues.
I've seen suggestions on StackOveflow to install the Command Line Tools, to run variants of xcode-select --install, and export CPATH and CPATH. This resolved the header error. I'm now getting the error
ld: library not found for -lSystem
collect2: error: ld returned 1 exit status
and
psutil/_psutil_osx.c:36:43: fatal error: CoreFoundation/CoreFoundation.h: No such file or directory
#include <CoreFoundation/CoreFoundation.h>
^
compilation terminated.
error: command 'gcc' failed with exit status 1
Has anyone come across anything similar?
I encountered the same problem after updating to Catalina macOS 10.15 and installing xcode 12 beta 6. My golang code failed compiling with error
share/go/src/crypto/x509/root_cgo_darwin.go:16:10: fatal error: 'CoreFoundation/CoreFoundation.h' file not found
#include <CoreFoundation/CoreFoundation.h>
Tried xcode-select --install, and other suggestions, none worked.
The final fix I found was to manually link directories that were messed up by the update.
Steps
1: turn off rootless/System Integrity Protection on Mac: Disable SIPe
This setup is needed to make change to system configuration.
reboot your mac and hold-on command + R to enter recovery mode.
Once in Recovery mode, open a Terminal window from the Utilities drop-down menu at the top of the screen. Type the following into the Terminal window:
csrutil disable
2: reboot into normal mode
3: open terminal, make the root folder writable
sudo mount -uw
4: fix the links
cd /System/Library/Frameworks/CoreFoundation.framework
ln -s /Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/System/Library/Frameworks/CoreFoundation.framework/Headers Headers
ln -s /Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/System/Library/Frameworks/CoreFoundation.framework/Modules Modules
cd /System/Library/Frameworks/Security.framework
ln -s /Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/System/Library/Frameworks/Security.framework/Headers Headers
ln -s /Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/System/Library/Frameworks/Security.framework/Modules Modules

mpi4py only works under mpiexec

I have set up mpi4py on a new server, and it isn't quite working. When I import mpi4py.MPI, it crashes. However, if I do the same thing under mpiexec, it works. On my other server and on my workstation, both techniques work fine. What am I missing on the new server?
Here's what happens on the new server:
$ python -c 'from mpi4py import MPI; print("OK")'
--------------------------------------------------------------------------
It looks like orte_init failed for some reason; your parallel process is
likely to abort. There are many reasons that a parallel process can
fail during orte_init; some of which are due to configuration or
environment problems. This failure appears to be an internal failure;
here's some additional information (which may only be relevant to an
Open MPI developer):
PMI2_Job_GetId failed failed
--> Returned value (null) (14) instead of ORTE_SUCCESS
--------------------------------------------------------------------------
--------------------------------------------------------------------------
It looks like orte_init failed for some reason; your parallel process is
likely to abort. There are many reasons that a parallel process can
fail during orte_init; some of which are due to configuration or
environment problems. This failure appears to be an internal failure;
here's some additional information (which may only be relevant to an
Open MPI developer):
orte_ess_init failed
--> Returned value (null) (14) instead of ORTE_SUCCESS
--------------------------------------------------------------------------
--------------------------------------------------------------------------
It looks like MPI_INIT failed for some reason; your parallel process is
likely to abort. There are many reasons that a parallel process can
fail during MPI_INIT; some of which are due to configuration or environment
problems. This failure appears to be an internal failure; here's some
additional information (which may only be relevant to an Open MPI
developer):
ompi_mpi_init: ompi_rte_init failed
--> Returned "(null)" (14) instead of "Success" (0)
--------------------------------------------------------------------------
*** An error occurred in MPI_Init_thread
*** on a NULL communicator
*** MPI_ERRORS_ARE_FATAL (processes in this communicator will now abort,
*** and potentially your MPI job)
[Octomore:45430] Local abort before MPI_INIT completed successfully; not able to aggregate error messages, and not able to guarantee that all other processes were killed!
If I run it with mpiexec, it's fine.
$ mpiexec -np 1 python -c 'from mpi4py import MPI; print("OK")'
OK
I'm running on CentOS 6.7. I've installed Python 2.7 as a software collection, and I've loaded the openmpi/gnu/1.10.2 module. MPICH and MPICH2 are also installed, so they may be conflicting with OpenMPI. I haven't loaded the MPICH modules, though. I'm running Python in a virtualenv:
$ pip list
mpi4py (2.0.0)
pip (8.1.2)
setuptools (18.0.1)
wheel (0.24.0)
It turned out that mpi4py is not compatible with version 1.10.2 of OpenMPI. It works fine with version 1.6.5.
$ module load openmpi/gnu/1.6.5
$ python -c 'from mpi4py import MPI; print("OK")'
OK

Running python LAMPP (linux) via apache

I have a file: test.py
Permissions on this file are set to 777, I am attempting to run the following script:
#!/usr/lib/python2.7
print("Content-Type: text/html\n")
print("test")
I receive the following error:
The server encountered an internal error and was unable to complete your request.
Error message:
End of script output before headers: test.py
If you think this is a server error, please contact the webmaster.
Error 500
Python is installed:
$ python --version
>> Python 2.7.4
Solved the problem, you need to use the location of the python interpreter in the first line of the code which can be found by running the following script in the python interpreter (can be invoked by typing python into the terminal):
import sys; sys.executable;

Categories

Resources