read files in a directory specified by a command line argument - python

I am trying to read files from a directory specified by a command line argument.The command line:
./printfiles.py ./test_dir
The code I have so far is:
#!/usr/bin/env python3
import os
import sys
input_dir=argv[1]
for file in os.listdir(input_path):
with open(file, "r") as f:
for line in f.readlines():
print(line)
I am getting the error:
FileNotFoundError: [Errno 2] No such file or directory: 'hello.txt'
I think that the problem is because os.listdir() only returns file names, not the path. I am confused as how to do this because the path is just specified by the user.

I think that the problem is because os.listdir() only returns file names, not the path.
I think you're correct.
You can give open the full path to the file by using os.path.join:
with open(os.path.join(input_dir, file), "r") as f:

Related

Why is this program "unable to find file or directory" when I am only trying to delete duplicate files?

I am trying to delete all duplicate files from my computer using a Python script
import os
import hashlib
# Set the directory you want to search for duplicate files
dir_path = "/Users/ebbyrandall"
# Create a dictionary to store the files and their corresponding hashes
files_dict = {}
# Walk through the directory and calculate the hash of each file
for root, dirs, files in os.walk(dir_path):
for file in files:
file_path = os.path.join(root, file)
with open(file_path, "rb") as f:
file_data = f.read()
file_hash = hashlib.md5(file_data).hexdigest()
# If the file hash is not in the dictionary, add it
# Otherwise, it's a duplicate and we should delete it
if file_hash not in files_dict:
files_dict[file_hash] = file_path
else:
os.remove(file_path)
I get the following error message:
Traceback (most recent call last):
File "deleteDuplicateFiles.py", line 14, in <module>
with open(file_path, "rb") as f:
IOError: [Errno 2] No such file or directory: '/Users/ebbyrandall/myPython/env/bin/python3'
Let's say you have this situation:
folder1/file.txt
And then run this:
import os
for folder in ['folder1/file.txt', 'folder1/other.txt', 'folder2/file.txt']:
try:
os.remove(folder)
print('file from {folder} removed')
except Exception as e:
print('problem removing file from folder{folder}:')
print(e)
The result is:
file from {folder} removed
problem removing file from folder{folder}:
[WinError 2] The system cannot find the file specified: 'folder1/other.txt'
problem removing file from folder{folder}:
[WinError 3] The system cannot find the path specified: 'folder2/file.txt'
This makes sense because in the first case, the file was there and could be removed. In the second case, the file didn't exist (error 2) and in the third case the folder didn't exist (error 3).
However, in your case, you were actually trying to open a folder as a file, or to open a file in a folder that doesn't exist:
try:
with open('folder', 'rb') as f:
print('File "folder" opened')
except Exception as e:
print('problem opening file "folder"')
print(e)
try:
with open('folder2/file.txt', 'rb') as f:
print('File "folder2/file.txt" opened')
except Exception as e:
print('problem opening file "folder2/file.txt"')
print(e)
Result:
problem opening file "folder"
[Errno 2] No such file or directory: 'folder'
problem opening file "folder2/file.txt"
[Errno 2] No such file or directory: 'folder2/file.txt'
The solution would be to distinguish files from folders and only to open files. Also, as the examples show, you can catch other errors (for example being unable to open a file that is locked by some other program) with a try .. except .. block.
Issues with symbolic links
Assume your file name /Users/ebbyrandall/myPython/env/bin/python3 is a symbolic link because folder myPython is a virtual environment created with venv.
Reproduce the error
Creating a virtual environment
python3 -m venv ./my_venv cd my_venv ls -l my_venv/bin/python3
shows a symbolic link: lrwxrwxrwx my_venv/bin/python3 -> /usr/bin/python3
Then trying to read from this file name:
import os
root = '/Users/hc_dev'
file = 'my_env/bin/python3'
file_path = os.path.join(root, file)
with open(file_path, "rb") as f:
file_data = f.read()
print(file_data)
outputs your error:
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
FileNotFoundError: [Errno 2] No such file or directory: '/Users/hc_dev/my_env/bin/python3'
Debug and test the type and existence
According to
How to check if file is a symlink in Python?
this file can be evaluated with pathlib as follows:
is not a link
is not a symlink
does not exist
is not a regular file
os.path.islink(file_path)
# False
from pathlib import Path
Path(file_path).is_symlink()
# False
Path(file_path).exists()
# False
Path(file_path).is_file()
# False

Can't open file in the same directory

I was following a python tutorial about files and I couldn't open a text file while in the same directory as the python script. Any reason to this?
f = open("test.txt", "r")
print(f.name)
f.close()
Error message:
Traceback (most recent call last):
File "c:\Users\07gas\OneDrive\Documents\pyFileTest\ManipulatingFiles.py", line 1, in <module>
f = open("test.txt", "r")
FileNotFoundError: [Errno 2] No such file or directory: 'test.txt'
Here's a screenshot of proof of it being in the same directory:
The problem is "test.txt" is a relative file path and will be interpreted relative to whatever the current working directory (CWD) happens to be when the script is run. One simple solution is to use the predefined __file__ module attribute which is the pathname of the currently running script to obtain the (aka "parent") directory the script file is in and use that to obtain an absolute filepath the data file in the same folder.
You should also use the with statement to ensure the file gets closed automatically.
The code below shows how to do both of these things:
from pathlib import Path
filepath = Path(__file__).parent / "test.txt"
with open(filepath, "r") as f:
print(f.name)

Python FileNotFoundError: [Errno 2] No such file or directory:

I am trying to open all the '*.json' files in a directory and get some data out of them
import json
import os #os module imported here
import glob
path = 'C:\Saba\Python Workspace'
for filename in os.listdir(path):
if filename.endswith('.json'):
with open(filename,'r') as f:
data = json.load(filename)
print(data['key'],end="*")
for path in data['paths']:
print(path['method'],end="*")
for resources in path['resources']:
print(resources['key'],end="*")
print("\b"+"$")
This is the Error i get :
Traceback (most recent call last):
File "c:/Saba/Python Workspace/folder.py", line 9, in <module>
with open(filename,'r') as f:
FileNotFoundError: [Errno 2] No such file or directory: 'order-securityTransferOrders-service-v1.0.0-inventory.json'
You are running the script in different path. Adding the absolute path of the filename will do the trick.
import os.path
for filename in os.listdir(path):
abs_file_path = os.path.abspath(filename)
if filename.endswith('.json'):
with open(abs_file_path,'r') as f:
# your code ....
replace line with open(filename,'r') as f: with with open(os.path.abspath(filename),'r') as f:
Where do you run this script ? Python tries to search for your Json file in the current script folder.
If you want Python to find within the given path, you should write somthin like :
with open(os.path.join(path,filename) ,'r') as f:

FileNotFoundError in opening txt file with python

I am trying to open a txt file for reading with this code:-
type_comments = [] #Declare an empty list
with open ('society6comments.txt', 'rt') as in_file: #Open file for reading of text data.
for line in in_file: #For each line of text store in a string variable named "line", and
type_comments.append(line.rstrip('\n')) #add that line to our list of lines.
Error:-
Error - Traceback (most recent call last):
File "c:/Users/sultan/python/society6/society6_promotion.py", line 6, in <module>
with open ('society6comments.txt', 'rt') as in_file:
FileNotFoundError: [Errno 2] No such file or directory: 'society6comments.txt'
I already have a file name with 'society6comments.txt' in the same directory has my script so why is it showing error?
The fact that the text file is in the same directory as your program does not make that directory the current working directory. Put the full path to the file in your open() call.
You can use os.path.dirname(__file__) to obtain the directory name of the script, and then join the file name you want:
import os
with open (os.path.join(os.path.dirname(os.path.abspath(__file__)), 'society6comments.txt'), 'rt') as in_file:

File not found error: Trying to import csv file into python. No such file or directory

So I'm getting the error:
[Errno 2] No such file or directory.
My csv file is ratings.csv I know for sure that my file exists.
Here's my code:
import csv
ifile = open('ratings.csv', "rb")
reader = csv.reader(ifile)
The working directory may be different. So though the file is there in the directory you are looking at, the script is not being executed there. Can you try with the full pathname of the file instead of the just the file name?
import csv
ifile = open('/home/dir2/dir3/ratings.csv', "rb")
reader = csv.reader(ifile)

Categories

Resources