Slicing strings of a sentence with a scale - python

So I need to create 3 functions for this assignment.
The first should do the following
numCol(): When dealing with plain text (and data written in plain text), it can be helpful to have a “scale” that indicates the columns in which characters appear. We create a scale using two lines (or “rows”). In the second row, we print 1234567890 repeatedly. In the first row (i.e., the line above the second row), we write the “tens” digits above the zeros in the second row as shown in the listing below. This function takes one argument, an integer, and prints a scale the length of your quote. It doesn't return anything.
The second should
docQuote(): Takes three arguments: 1) the quote as a string, 2) the slice start value, and 3) the slice end value. It returns the doctored string.
The third should
main(): Takes no arguments and returns nothing. Prompts user for original quote and number
of slices needed. Then in a for-loop, calls numCol() in such a way that the scale is the length of the quote, prompts the user for the start and end slice values (recall that the end value isn’t included in the slice), and then calls docQuote(). Finally, it prints the final doctored quote.
If the program is correct its output should look as follows:
1. Enter quote: Money is the root of all evil.
2. Enter the number of slices needed: 2
3. 1 2
4. 012345678901234567890123456789
5. Money is the root of all evil.
6. Start and end for slicing separated by a comma: 8, 20
7. 1
8. 012345678901234567
9. Money is all evil.
10. Start and end for slicing separated by a comma: 12, 17
11. -> Money is all.
What I have so far: (Will update if I figure something out)
def numCol(x):
col=[]
for i in range(1,(round(n)//10)+1):
col.append(str(i))
print(" "," ".join(col),end="")
def docQuote(x,y,z):
return
def main():
x=input("Enter quote: ")
y=int(input("Enter the number of slices needed: "))
numCol(len(x)-1)
print(x)
main()

Ok: you have to define a function called numCol which takes one integer argument:
def numCol(n):
then you have to print a line consisting of n characters, where every tenth character is an incrementing integer and every other character is a space.
chars = []
for i in range(1, n+1):
if i % 10:
chars.append(" ")
else:
chars.append(str((i % 100) // 10))
print(''.join(chars))
and finally a row consisting of 'n' chars, being 1234567890 repeating:
chars = []
for i in range(1, n+1):
chars.append(str(i % 10))
print(''.join(chars))
which then runs as
>>> numCol(65)
1 2 3 4 5 6
12345678901234567890123456789012345678901234567890123456789012345
Edit:
In response to #AdamSmith:
Let's see some actual numbers:
from textwrap import dedent
from timeit import Timer
test_statements = [
(
"n = 65",
"""
# as a for-loop
chars = []
for i in xrange(1, n+1):
if i % 10:
chars.append(" ")
else:
chars.append(str((i % 100) // 10))
"""
),
(
"n = 65",
"""
# as a list comprehension
chars = [" " if i%10 else str((i%100)//10) for i in xrange(1,n+1)]
"""
),
(
"n = 65",
"""
# extra cost of list-to-string
chars = [" " if i%10 else str((i%100)//10) for i in xrange(1,n+1)]
s = ''.join(chars)
"""
),
(
"n = 65",
"""
# vs cost of generator-to-string
chars = (" " if i%10 else str((i%100)//10) for i in xrange(1,n+1))
s = ''.join(chars)
"""
),
(
"s = ' 1 2 3 4 5 6 '",
"""
# cost of actually displaying string
print(s)
"""
)
]
for setup,run in test_statements:
res = Timer(dedent(run), setup)
times = res.repeat() # 3 * 1000000 runs
print("{:7.1f}".format(min(times)) # time of one loop in microseconds
on my system (i5-760, Win7 x64, Python 2.7.5 64bit) this gives
15.1 # for-loop -> list of chars
10.7 # list comprehension -> list of chars
11.4 # list comprehension -> string
13.6 # generator expression -> string
132.1 # print the string
Conclusions:
a list comprehension is 29% faster than a for-loop at building a list of characters
a generator expression is 19.6% slower than a list comprehension at building a list of characters and joining to a string
it's pretty much irrelevant, because actually printing the output takes 9 times longer than generating it with any of these methods - by the time you print the string out, using a list comprehension (fastest) is just 2.9% faster than the for-loop (slowest).
#user3482104
If you really want to avoid if ... else, you can do
if stmt:
do_a()
if not stmt: # same effect as 'else:'
do_b()
but be aware that this has to evaluate stmt twice where else only evaluates it once.
Also, because both loops are iterating over the same range (same start/end values), you can combine the loops:
def numCol(n):
firstline = []
secondline = []
for i in range(1, n+1):
i %= 100
tens, ones = i // 10, i % 10
if ones: # ones != 0
firstline.append(" ")
if not ones: # ones == 0 # <= 'else:'
firstline.append(str(tens))
secondline.append(str(ones))
print(''.join(firstline))
print(''.join(secondline))

Related

Is string iteration with single loop is slower compared to iteration of list created from string.split() with multiple loops?

I was working on a simple code problem where I need to Write a function which takes a string as input and prints reversed string in 3 formats as shown below.
reverse_str("Hello Folks Lets Code") --> output as below
edoC steL skloF olleH
Code Lets Folks Hello
olleH skloF steL edoC
And I have written below function with a single while loop which only traverse one time through the string and gives the above output. This works perfectly fine.
def reverse_str(inp_str: str):
original_word=''
reversed_word=''
order_word_rvrsd=''
order_rvrsd=''
word_rvrsd=''
indx=0
while True:
try:
c=inp_str[indx]
if c!=' ':
original_word+=c
reversed_word=c+reversed_word
else :
order_word_rvrsd=reversed_word+c+order_word_rvrsd
order_rvrsd=original_word+c+order_rvrsd
word_rvrsd=word_rvrsd+reversed_word+c
original_word=''
reversed_word=''
indx+=1
except IndexError:
c=' '
order_word_rvrsd=reversed_word+c+order_word_rvrsd
order_rvrsd=original_word+c+order_rvrsd
word_rvrsd=word_rvrsd+reversed_word
break
print(order_word_rvrsd,order_rvrsd,word_rvrsd,sep='\n')
But I found below smaller function from someone which does the same thing , but split the input string to list of words and iterate through it multiple times:
def reverseStr(s: str):
splitted_s = s.split(" ")
l = len(splitted_s)
out1 = ""
out2 = ""
out3 = ""
for i in range(1, l+1):
out1 += splitted_s[-i][::-1] + " "
for i in range(1, l+1):
out2 += splitted_s[-i] + " "
for i in range(l):
out3 += splitted_s[i][::-1] + " "
print(out1,out2,out3,sep='\n')
As per time complexity analysis my approach with single loop should be of O(n) complexity since it iterates through string characters only once. While the second function does it multiple time. But surprisingly with bigger strings , second function is running faster than first one of mine.
Is this because string iteration with single loop is slower compared to iteration of list of words created from string.split() with multiple loops?
Any help to understand is highly appreciated
I did some rough calculations.
inp_str = ' '.join([''.join(random.choices(string.ascii_uppercase + string.digits, k = 4)) for indx in range(10000)])
The inp_str string has a length of 10000 * 5 = 50000 characters and a space every 4 characters (10000 words).
The loop in the reverse_str function:
indx = 0
while True:
try:
# ...
indx += 1
except IndexError:
# ...
break
is executed 50000 times. It means an input of 10000 space-chars and 40000 letters/numbers.
For every non-space character there are 2 assignments and 2 concatenations
original_word += c
reversed_word = c + reversed_word
for space characters there are, at least, 3 assignments and 6 concatenations
order_word_rvrsd = reversed_word + c + order_word_rvrsd
order_rvrsd = original_word + c + order_rvrsd
word_rvrsd = word_rvrsd + reversed_word + c
The total is: 40000 * 2 + 10000 *3 = 110000 assignments and 40000 * 2 + 10000 * 6 = 140000 concatenations.
The reverseStr function has three loops each working on (more or less) 10000 words.
The first loop (for i in range(1, l+1):) is executed 10000 times (1 assignment and 2 concatenations);
the second loop (for i in range(1, l+1):) is executed 10000 times (1 assignment and 2 concatenations);
the last loop is executed 10000 times (1 assignment and 2 concatenations);
So the total is: 30000 assignments and 60000 concatenations.
The difference is enough to compensate for the initial word-splitting (it probably, roughly requires 10000 assignments).
The performance difference increases with the average length of a word in the input string.

How to find the max number of times a sequence of characters repeats consecutively in a string? [duplicate]

This question already has answers here:
How to count consecutive repetitions of a substring in a string?
(4 answers)
Closed 1 year ago.
I'm working on a cs50/pset6/dna project. I'm struggling with finding a way to analyze a sequence of strings, and gather the maximum number of times a certain sequence of characters repeats consecutively. Here is an example:
String: JOKHCNHBVDBVDBVDJHGSBVDBVD
Sequence of characters I should look for: BVD
Result: My function should be able to return 3, because in one point the characters BVD repeat three times consecutively, and even though it repeats again two times, I should look for the time that it repeats the most number of times.
It's a bit lame, but one "brute-force"ish way would be to just check for the presence of the longest substring possible. As soon as a substring is found, break out of the loop:
EDIT - Using a function might be more straight forward:
def get_longest_repeating_pattern(string, pattern):
if not pattern:
return ""
for i in range(len(string)//len(pattern), 0, -1):
current_pattern = pattern * i
if current_pattern in string:
return current_pattern
return ""
string = "JOKHCNHBVDBVDBVDJHGSBVDBVD"
pattern = "BVD"
longest_repeating_pattern = get_longest_repeating_pattern(string, pattern)
print(len(longest_repeating_pattern))
EDIT - explanation:
First, just a simple for-loop that starts at a larger number and goes down to a smaller number. For example, we start at 5 and go down to 0 (but not including 0), with a step size of -1:
>>> for i in range(5, 0, -1):
print(i)
5
4
3
2
1
>>>
if string = "JOKHCNHBVDBVDBVDJHGSBVDBVD", then len(string) would be 26, if pattern = "BVD", then len(pattern) is 3.
Back to my original code:
for i in range(len(string)//len(pattern), 0, -1):
Plugging in the numbers:
for i in range(26//3, 0, -1):
26//3 is an integer division which yields 8, so this becomes:
for i in range(8, 0, -1):
So, it's a for-loop that goes from 8 to 1 (remember, it doesn't go down to 0). i takes on the new value for each iteration, first 8 , then 7, etc.
In Python, you can "multiply" strings, like so:
>>> pattern = "BVD"
>>> pattern * 1
'BVD'
>>> pattern * 2
'BVDBVD'
>>> pattern * 3
'BVDBVDBVD'
>>>
A slightly less bruteforcey solution:
string = 'JOKHCNHBVDBVDBVDJHGSBVDBVD'
key = 'BVD'
len_k = len(key)
max_l = 0
passes = 0
curr_len=0
for i in range(len(string) - len_k + 1): # split the string into substrings of same len as key
if passes > 0: # If key was found in previous sequences, pass ()this way, if key is 'BVD', we will ignore 'VD.' and 'D..'
passes-=1
continue
s = string[i:i+len_k]
if s == key:
curr_len+=1
if curr_len > max_l:
max_l=curr_len
passes = len(key)-1
if prev_s == key:
if curr_len > max_l:
max_l=curr_len
else:
curr_len=0
prev_s = s
print(max_l)
You can do that very easily, elegantly and efficiently using a regex.
We look for all sequences of at least one repetition of your search string. Then, we just need to take the maximum length of these sequences, and divide by the length of the search string.
The regex we use is '(:?<your_sequence>)+': at least one repetition (the +) of the group (<your_sequence>). The :? is just here to make the group non capturing, so that findall returns the whole match, and not just the group.
In case there is no match, we use the default parameter of the max function to return 0.
The code is very short, then:
import re
def max_consecutive_repetitions(search, data):
search_re = re.compile('(?:' + search + ')+')
return max((len(seq) for seq in search_re.findall(data)), default=0) // len(search)
Sample run:
print(max_consecutive_repetitions("BVD", "JOKHCNHBVDBVDBVDJHGSBVDBVD"))
# 3
This is my contribution, I'm not a professional but it worked for me (sorry for bad English)
results = {}
# Loops through all the STRs
for i in range(1, len(reader.fieldnames)):
STR = reader.fieldnames[i]
j = 0
s=0
pre_s = 0
# Loops through all the characters in sequence.txt
while j < (len(sequence) - len(STR)):
# checks if the character we are currently looping is the same than the first STR character
if STR[0] == sequence[j]:
# while the sub-string since j to j - STR lenght is the same than STR, I called this a streak
while sequence[j:(j + len(STR))] == STR:
# j skips to the end of sub-string
j += len(STR)
# streaks counter
s += 1
# if s > 0 means that that the whole STR and sequence coincided at least once
if s > 0:
# save the largest streak as pre_s
if s > pre_s:
pre_s = s
# restarts the streak counter to continue exploring the sequence
s=0
j += 1
# assigns pre_s value to a dictionary with the current STR as key
results[STR] = pre_s
print(results)

Compressing multiple nested `for` loops

Similar to this and many other questions, I have many nested loops (up to 16) of the same structure.
Problem: I have 4-letter alphabet and want to get all possible words of length 16. I need to filter those words. These are DNA sequences (hence 4 letter: ATGC), filtering rules are quite simple:
no XXXX substrings (i.e. can't have same letter in a row more than 3 times, ATGCATGGGGCTA is "bad")
specific GC content, that is number of Gs + number of Cs should be in specific range (40-50%). ATATATATATATA and GCGCGCGCGCGC are bad words
itertools.product will work for that, but data structure here gonna be giant (4^16 = 4*10^9 words)
More importantly, if I do use product, then I still have to go through each element to filter it out. Thus I will have 4 billion steps times 2
My current solution is nested for loops
alphabet = ['a','t','g','c']
for p1 in alphabet:
for p2 in alphabet:
for p3 in alphabet:
...skip...
for p16 in alphabet:
word = p1+p2+p3+...+p16
if word_is_good(word):
good_words.append(word)
counter+=1
Is there good pattern to program that without 16 nested loops? Is there a way to parallelize it efficiently (on multi-core or multiple EC2 nodes)
Also with that pattern i can plug word_is_good? check inside middle of the loops: word that starts badly is bad
...skip...
for p3 in alphabet:
word_3 = p1+p2+p3
if not word_is_good(word_3):
break
for p4 in alphabet:
...skip...
from itertools import product, islice
from time import time
length = 16
def generate(start, alphabet):
"""
A recursive generator function which works like itertools.product
but restricts the alphabet as it goes based on the letters accumulated so far.
"""
if len(start) == length:
yield start
return
gcs = start.count('g') + start.count('c')
if gcs >= length * 0.5:
alphabet = 'at'
# consider the maximum number of Gs and Cs we can have in the end
# if we add one more A/T now
elif length - len(start) - 1 + gcs < length * 0.4:
alphabet = 'gc'
for c in alphabet:
if start.endswith(c * 3):
continue
for string in generate(start + c, alphabet):
yield string
def brute_force():
""" Straightforward method for comparison """
lower = length * 0.4
upper = length * 0.5
for s in product('atgc', repeat=length):
if lower <= s.count('g') + s.count('c') <= upper:
s = ''.join(s)
if not ('aaaa' in s or
'tttt' in s or
'cccc' in s or
'gggg' in s):
yield s
def main():
funcs = [
lambda: generate('', 'atgc'),
brute_force
]
# Testing performance
for func in funcs:
# This needs to be big to get an accurate measure,
# otherwise `brute_force` seems slower than it really is.
# This is probably because of how `itertools.product`
# is implemented.
count = 100000000
start = time()
for _ in islice(func(), count):
pass
print(time() - start)
# Testing correctness
global length
length = 12
for x, y in zip(*[func() for func in funcs]):
assert x == y, (x, y)
main()
On my machine, generate was just a bit faster than brute_force, at about 390 seconds vs 425. This was pretty much as fast as I could make them. I think the full thing would take about 2 hours. Of course, actually processing them will take much longer. The problem is that your constraints don't reduce the full set much.
Here's an example of how to use this in parallel across 16 processes:
from multiprocessing.pool import Pool
alpha = 'atgc'
def generate_worker(start):
start = ''.join(start)
for s in generate(start, alpha):
print(s)
Pool(16).map(generate_worker, product(alpha, repeat=2))
Since you happen to have an alphabet of length 4 (or any "power of 2 integer"), the idea of using and integer ID and bit-wise operations comes to mind instead of checking for consecutive characters in strings. We can assign an integer value to each of the characters in alphabet, for simplicity lets use the index corresponding to each letter.
Example:
6546354310 = 33212321033134 = 'aaaddcbcdcbaddbd'
The following function converts from a base 10 integer to a word using alphabet.
def id_to_word(word_id, word_len):
word = ''
while word_id:
rem = word_id & 0x3 # 2 bits pet letter
word = ALPHABET[rem] + word
word_id >>= 2 # Bit shift to the next letter
return '{2:{0}>{1}}'.format(ALPHABET[0], word_len, word)
Now for a function to check whether a word is "good" based on its integer ID. The following method is of a similar format to id_to_word, except a counter is used to keep track of consecutive characters. The function will return False if the maximum number of identical consecutive characters is exceeded, otherwise it returns True.
def check_word(word_id, max_consecutive):
consecutive = 0
previous = None
while word_id:
rem = word_id & 0x3
if rem != previous:
consecutive = 0
consecutive += 1
if consecutive == max_consecutive + 1:
return False
word_id >>= 2
previous = rem
return True
We're effectively thinking of each word as an integer with base 4. If the Alphabet length was not a "power of 2" value, then modulo % alpha_len and integer division // alpha_len could be used in place of & log2(alpha_len) and >> log2(alpha_len) respectively, although it would take much longer.
Finally, finding all the good words for a given word_len. The advantage of using a range of integer values is that you can reduce the number of for-loops in your code from word_len to 2, albeit the outer loop is very large. This may allow for more friendly multiprocessing of your good word finding task. I have also added in a quick calculation to determine the smallest and largest IDs corresponding to good words, which helps significantly narrow down the search for good words
ALPHABET = ('a', 'b', 'c', 'd')
def find_good_words(word_len):
max_consecutive = 3
alpha_len = len(ALPHABET)
# Determine the words corresponding to the smallest and largest ids
smallest_word = '' # aaabaaabaaabaaab
largest_word = '' # dddcdddcdddcdddc
for i in range(word_len):
if (i + 1) % (max_consecutive + 1):
smallest_word = ALPHABET[0] + smallest_word
largest_word = ALPHABET[-1] + largest_word
else:
smallest_word = ALPHABET[1] + smallest_word
largest_word = ALPHABET[-2] + largest_word
# Determine the integer ids of said words
trans_table = str.maketrans({c: str(i) for i, c in enumerate(ALPHABET)})
smallest_id = int(smallest_word.translate(trans_table), alpha_len) # 1077952576
largest_id = int(largest_word.translate(trans_table), alpha_len) # 3217014720
# Find and store the id's of "good" words
counter = 0
goodies = []
for i in range(smallest_id, largest_id + 1):
if check_word(i, max_consecutive):
goodies.append(i)
counter += 1
In this loop I have specifically stored the word's ID as opposed to the actual word itself incase you are going to use the words for further processing. However, if you are just after the words then change the second to last line to read goodies.append(id_to_word(i, word_len)).
NOTE: I receive a MemoryError when attempting to store all good IDs for word_len >= 14. I suggest writing these IDs/words to a file of some sort!

Using raw_input with functions in Python

I want to execute a function certain number of times as specified by the user, for user-specified values. I have written the following code
queries = int(raw_input("The number of queries to run: "))
for i in range(0, queries):
a, b = raw_input().split(" ")
def count_substring(str):
length = len(str) + 1
found = []
for i in xrange(0, length):
for j in xrange(i+1, length):
if str[i] == a and str[j-1] == b:
found.append(str[i:j])
print len(found)
string = 'aacbb'
print count_substring(string)
The function gives the number of sub-strings that start and end with user specified characters.
For ex:
In the string "aacbb" the number of sub strings starting with a and ending with c are 2.
Queries indicates the number of inputs, ex for queries = 2 , there will be two inputs of the sub strings, i.e a & c or a & b
I want this code to return 2 values as answers, but it returns only 1.

New Programmer: For Loops and While Loops(python) [duplicate]

This question already has answers here:
Understanding slicing
(38 answers)
Closed 7 years ago.
I'm a new programmer and I'm having a lot of trouble understanding for loops and while loops. In what situations would I know to use a for loop and in what situations would I know to use a while loop?
Also, could you explain to me what these 2 codes mean? I have a a lot of confusion.
1 function:
def every_nth_character(s, n):
""" (str, int) -> str
Precondition: n > 0
Return a string that contains every nth character from s, starting at index 0.
>>> every_nth_character('Computer Science', 3)
'CpeSee'
"""
result = ''
i = 0
while i < len(s):
result = result + s[i]
i = i + n
return result
****What does s[i] mean?****
2nd function:
def find_letter_n_times(s, letter, n):
""" (str, str, int) -> str
Precondition: letter occurs at least n times in s
Return the smallest substring of s starting from index 0 that contains
n occurrences of letter.
>>> find_letter_n_times('Computer Science', 'e', 2)
'Computer Scie'
"""
i = 0
count = 0
while count < n:
if s[i] == letter:
count = count + 1
i = i + 1
return s[:i]
what does s[i] and s[:i] mean??
S is a list of characters 'Computer Science'["C","o","m","p"...], and i is the indexposition for each item/character in the list S, so in your case you've stated that your loop counts each third(3) item in S as long as there are items in S, that is, S[i] = [C], S[i]=[p], S=[e], S[i]= C, S[i]=p, where i is each third element in S.
In the second case you've defined i as a variable with value 0, after each loop i increases with +1, i = i + 1, and [:i] means return elements in S up to the latest looped slice, for instance "Computer Scie" + one additional loop would give you "Computer Scien" (i = 9 (the current range of S/number looped characters in S) -> i+1 (increased by +1) -> i=10 (i = 10, S[i]=10 means the first 10 indexpositions/charachters in S]
Your first question about differencies in while and for loops is completely answered here.
Strings and indexing:
Variable s holds a string value. As you may have noticed, it has been submitted as an argument for every_nth_character(s, n) function.
Now every letter in a string is in some position and that position is called index. indexing starts from 0. So if we have a string s containing value 'foo123', it's first character s[0] is 'f' and the last character s[5] = 3.
String can be cutted and sliced using ':' in the index field. Referring to the previous example, we have determined string s. Now you can take only first three characters of that string by using s[:3] and get 'foo' as a result. Read more about it here
Loops:
While and for loops start over and over again until they reach the limit you have determined.
For example:
x = 0
while x < 5:
print x
x = x + 1
prints numbers from 0 to 4. Variable x increases +1 at every single run and the loop ends when x reaches value 5.
Get familiar with Python documentation page, it will help you a lot in future especially in basic things. Google search: Python (your-python-version) documentation

Categories

Resources