Reading/writing error messages from data factory pipelines - python

Going to try asking this here.
I'm trying to write an error message from an Azure Data Factory pipeline to a table in SQL server. It needs to capture the error message from a Databricks Python job. I can't find any official documentation and the method I have found from this source:
#{activity('Proc source').error.message}
..doesn't write anything to the table. Just a blank string with no explanation.
Why data factory doesn't just have an area where you can view the details of errors instead of just saying "Failed" is beyond me. Or if it does, it's hidden away.
Does anyone have any ideas?

You can see the details of error at here.
#{activity('Proc source').error.message}
This expression works.
Is errorCode saved to your table?Make sure your activity name is correct.

SOLVED:
For anyone else reading this, the problem turned out to be something very stupid. I'd included a space in the python file name.
This returned an error code of 3202 and a blank error message.
I had another problem and resolution after this that I'd like to share, again for anyone frantically googling a solution to the problem. Once I'd removed spaces from the python filename, I logged an error code of '3204'
and the error message: "Databricks execution failed with error message: . Run page url: (link to page showing clusters)". In the Databricks workspace launchable through the Azure portal, selecting a cluster through the 'clusters' sidebar then heading to 'Driver Logs' will show errors, in the 'Standard error' window that comes up.
I had already installed the libraries I needed on an existing cluster, but I'd forgotten to change a setting in the Databricks linked service. 'Select cluster' was set to 'new job cluster' when I needed 'Existing interactive cluster'. Thus, it wasn't pointing to the cluster I had expected.
These are all fairly small errors as it turns out, but again I hope that someone else dealing with the same issues will be able to find this post and save themselves some hassle!

Related

Recieving Null response from visitorsession variable during deployment salesIq zo

I am a little baffled with the issue I am facing with Zobot. I have developed a Zobot in which I am using visitorsession to store some values and reuse them later. It works great in Zoho Developer environment, we used Deluge scripts option to do the development.
But when I deploy it using embed script on my website, the visitorsession part of the code is returning null. I searched around and found not a single person facing this issue or posting it, I am really surprised its happening only to me. Can someone please suggest what I should do. I have explained what I am facing below:
I am storing values like this
storeResponse2 = zoho.salesiq.visitorsession.set(portal_name,{"a":"b"});
I am getting the values like this
zoho.salesiq.visitorsession.get(portal_name,"a").get("data").get("a");
It is working great in Zobot Development environment in the Preview section, but when I go to my website where I put the embed, I am getting null.
In both environments, the response I get when I do the set is the same. Its not throwing any error, it is giving me valid response. The response I am getting when I set, in both environments is:
{"url":"/api/v2/bigtalk/visitorsessions","object":"session","data":{"a":"b"}}
But when I do a get, in Zoho environment I get correct value, in production I get null
Attachments area
If this happens, it probably means that you are setting and getting the data from visitorsession in the same execution.
It doesn't work that way. It should be set in one execution and get in further executions (replies). And this won't be a problem anyway, as in the same execution, you'll have the data available already.

My Google Docs getting weird in formatting and difficult to edit

Crop of my google docs
So, I don't know what happen to my google docs, but everything went well until I tried to open the ".xlsx" file using openpyxl module in Python
I am not sure as well if it was caused by the module itself or what caused the error in my google docs.
So, basically my google docs is getting difficult to be edited. When i tried to move my cursor at certain points, it always brings the cursor in the beginning of the sentence at particular line. Next if I type something it always appear at the section "IT APPEARS HERE". And last thing, if i type something without a space or enter, it will not type in the new line but it seems like just breaching the page border and goes beyond that. I don't know what is going on here.
I am wondering if it was caused by my trial & error in the python code (?), but seems like no direct correlation between that. So, yeah I need your advice on this guys.. I really appreciate your help
.xlsx is file format for Microsoft Excel, try opening with Google Sheets
Might be related to the issue described here: https://www.androidpolice.com/2021/04/14/if-youre-using-an-ad-blocker-in-google-docs-you-could-run-into-weird-problems/
Basically: Disable your adblocker for google docs for now.

Problems flagging/unflagging JIRA issues using jira-python

I use the Python JIRA API wrapper almost daily to log time, add comments, and transition issues. Recently my team decided to replace the "Roadblock" status with an "Impediment" flag. My issue is that I cannot flag/unflag an issue from within an issue (https://jira.atlassian.com/browse/JSWSERVER-16346).
The following code to update customfield_10500 (the flag) does not work:
jira = JIRA(options=options, basic_auth=(os.getenv('user'), os.getenv('pass')))
i = jira.issue('BIS-9')
i.update(fields={
'customfield_10500' : {'value' : 'Impediment'}
})
The error
JIRAError: JiraError HTTP 400 url
response text = {"errorMessages":[],"errors":{"customfield_10500":"Field 'customfield_10500' cannot be set. It is not on the appropriate screen, or unknown."}}
I know the field must be set within the Kanban board, but I don't know how to do this using the Python wrapper.
Is there a way to do this?
I've found this but don't know how to translate it.
If you want to update a customfield through RestApi the customfield should be added into the Edit Mode Screen.
I believe this is why it is showing the above error

CKAN 2.2 - strange error while adding resource

I have the following issue:
I fill in the form for creating a new dataset.
I click the button 'Next: Add Data'. (All given data are proceeded as valid)
CKAN redirects me to the error page with the following text:
404 Not Found. The resource could not be found. The dataset XXX could not be found.
I checked the database and the dataset was not created.
This issue appers just sometimes. Do you have any idea what could cause such strange behaviour?
I have the same error, using suggestion from #bellisk helped me solved it. the details of my error and solution is in this ticket Error 404 not found uploading dataset to YYC Data Collective (CKAN)
Notice that in my case plugin is "validation" but in your case it can be different however the solution is the same . Just disable the culprit plugin by removing its name in configuration file and do not forget to restart the server.
Remove plugin one by one until you find the bad one :). Hope it will help. Thanks Bellisk!

Posting new targets to vuforia with Python

I'm trying to make a cms with Python to post new targets to a cloud database on vuforia. I found this Python library "python-vuforia" but it has read functionalities only.
I added a function to post targets but so far getting 401 error. you can find the new function in this commit
What am I doing wrong?
Got it working with this (commit)[https://github.com/dadoeyad/python-vuforia/commit/1997a49f94c5f2e13ab1d5c620c69160c76b7969]
I think the problem was with doing str(req.get_data()) instead of req.get_data()
and base64.b64encode(hmac(key, message, sha1).digest()) instead of hmac(key, message, sha1).digest().encode('base64')

Categories

Resources