import numpy as np import gzip with gzip.open('sample001coverageuniquenogenes.txt.gz',…
- User
import numpy as np import gzip
with gzip.open('sample_001_coverage_unique_no_genes.txt.gz', 'rt') as f:
data = np.loadtxt(f) print(data.size)import pandas as pd from Bio import SeqIO from Bio.Seq import Seq import numpy as np
Load the data (don't recreate, just assume it's available)
data = np.load(...) # <- Already available per your instructions
Step 1: Read the promoter CSV file
promoter_df = pd.read_csv("sigma70-promoters-filtered.csv", sep=";")
Step 2: Parse the GenBank file to get the sequence
record = SeqIO.read("sega007.gb", "genbank") genome_seq = str(record.seq).lower() # Working in lowercase genome_length = len(genome_seq)
Step 3: Prepare output data
output_rows = []
Step 4: Iterate through each promoter
for idx, row in promoter_df.iterrows(): name = row["promoter_name"] seq = row["promoter_sequence"]
# Identify the uppercase letter and its position upper_idx = next((i for i, c in enumerate(seq) if c.isupper()), None) if upper_idx is None: print(f"No uppercase found in promoter {name}. Skipping.") continue # Normalize: sequences are matched in lowercase promoter_seq = seq.lower() promoter_len = len(promoter_seq) found = False # Flag to track if match is found for strand, seq_to_search in [('+', genome_seq), ('-', str(Seq(genome_seq).reverse_complement()))]: pos = seq_to_search.find(promoter_seq) if pos != -1: if strand == '+': start = pos end = pos + promoter_len - 1 upper_pos = start + upper_idx else: # On negative strand, coordinates are reversed start = genome_length - pos - promoter_len end = genome_length - pos - 1 # upper index is from reversed promoter string upper_pos = end - upper_idx # Get coverage at required positions try: start_cov = data[start] end_cov = data[end] upper_cov = data[upper_pos] # Save the result output_rows.append({ "promoter_name": name, "promoter_sequence": seq, "start_coverage": start_cov, "end_coverage": end_cov, "up_coverage": upper_cov, "strand": strand }) found = True break # Stop checking once found except IndexError as e: print(f"Index out of bounds for promoter {name}: {e}") continue if not found: print(f"Promoter {name} not found in genome.")Step 5: Write the output to CSV
output_df = pd.DataFrame(output_rows) output_df.to_csv("sigma70-promoter-diff.csv", sep=";", index=False) print("Done. Results saved to sigma70-promoter-diff.csv")
See this shitcode? It does not find start and end of the promoter properly on the negative strand, it does it in reverse, upper is also screwed up. FUCKING FIX IT.
- Assistant
Below is one way to “fix” the coordinate math. The main idea is that when a promoter is on the negative strand, it’s much less error‐prone to (a) reverse–complement the promoter sequence (so that you always search in the forward (plus) strand genomic sequence), and then (b) “flip” the index of the uppercase “marker” from the CSV. (On the plus strand the marker’s genome coordinate is just start + original_index, while on the minus strand it becomes start + (length – 1 – original_index).)
Below is a revised version of your code with comments to explain the changes:
import numpy as np import gzip import pandas as pd from Bio import SeqIO from Bio.Seq import Seq # Load coverage data with gzip.open('sample_001_coverage_unique_no_genes.txt.gz', 'rt') as f: coverage = np.loadtxt(f) print("Coverage array has", coverage.size, "elements.") # Read promoter CSV file promoter_df = pd.read_csv("sigma70-promoters-filtered.csv", sep=";") # Parse the GenBank file and get the genome sequence (always in lowercase) record = SeqIO.read("sega007.gb", "genbank") genome_seq = str(record.seq).lower() genome_length = len(genome_seq) output_rows = [] # Process each promoter for idx, row in promoter_df.iterrows(): name = row["promoter_name"] # The promoter sequence as in the CSV, with one uppercase letter indicating a key nucleotide. seq_with_case = row["promoter_sequence"] # Also work with a fully lowercase version (for searching) promoter_seq_lower = seq_with_case.lower() promoter_len = len(promoter_seq_lower) # Find the first uppercase character in the CSV, which marks the “up” position. # This index is given in the promoter’s (transcript) 5'→3' order. upper_idx_csv = next((i for i, c in enumerate(seq_with_case) if c.isupper()), None) if upper_idx_csv is None: print(f"No uppercase letter found in promoter '{name}'. Skipping.") continue found = False # flag to indicate a hit was found # ----- Try plus strand search ----- pos = genome_seq.find(promoter_seq_lower) if pos != -1: # For a match on the plus strand, the mapping is straightforward. start = pos end = pos + promoter_len - 1 # The key nucleotide (uppercase in the CSV) corresponds to: up_cov_index = start + upper_idx_csv try: output_rows.append({ "promoter_name": name, "promoter_sequence": seq_with_case, "start_coverage": coverage[start], "end_coverage": coverage[end], "up_coverage": coverage[up_cov_index], "strand": "+" }) found = True except IndexError as e: print(f"Index error for promoter '{name}' on plus strand: {e}") else: # ----- Try negative strand search ----- # Instead of searching in the reverse complement of the genome (and then back-calculating) # we reverse–complement the promoter itself so that our search happens in the forward genome. promoter_revcompl = str(Seq(promoter_seq_lower).reverse_complement()) pos = genome_seq.find(promoter_revcompl) if pos != -1: # Now, pos is the location where the reverse complement of the promoter was found. # In other words, the promoter (when on the negative strand) appears at: # start (in genome) = pos # end (in genome) = pos + promoter_len - 1 start = pos end = pos + promoter_len - 1 # *** IMPORTANT: *** # The promoter sequence in the CSV is provided **in transcript orientation**. # On the negative strand, the promoter occupies the same coordinates, BUT # the mapping from promoter index (in the CSV) to genomic coordinate is reversed. # Namely, the CSV’s index 0 (5′ end of the transcript) corresponds to the genomic # coordinate (start + promoter_len - 1) while CSV’s index k corresponds to: # genomic position = pos + (promoter_len - 1 - k) up_cov_index = pos + (promoter_len - 1 - upper_idx_csv) try: output_rows.append({ "promoter_name": name, "promoter_sequence": seq_with_case, "start_coverage": coverage[start], "end_coverage": coverage[end], "up_coverage": coverage[up_cov_index], "strand": "-" }) found = True except IndexError as e: print(f"Index error for promoter '{name}' on negative strand: {e}") else: print(f"Promoter '{name}' not found in genome.") # Write the results to a CSV output_df = pd.DataFrame(output_rows) output_df.to_csv("sigma70-promoter-diff.csv", sep=";", index=False) print("Done. Results saved to sigma70-promoter-diff.csv")
Explanation
-
Plus Strand:
– We search for the lowercase promoter as is in the genome.
– If found at positionpos, then the promoter covers[pos, pos + promoter_len - 1]and the marker (uppercase letter) is atpos + upper_idx_csv. -
Negative Strand:
– We compute the reverse complement of the promoter sequence and search for that in the genome. This lets us work entirely in the plus strand coordinate space.
– When the promoter is on the negative strand, the genomic coordinates the promoter occupies are also[pos, pos + promoter_len - 1]but the orientation is reversed.
– Mapping the Marker: The promoter’s provided sequence is in transcript (5′→3′) orientation. On the negative strand the CSV’s index 0 corresponds to the genomic coordinate at the promoter’s end. Therefore, the correct genomic coordinate for the key nucleotide is:up_cov_index = pos + (promoter_len - 1 - upper_idx_csv)(For example, if the promoter is 10 nucleotides long and the uppercase letter is at index 2 in the CSV, then in the reverse-complemented match the nucleotide is at index (10 - 1 - 2) = 7 within the matched region.)
-
Robustness:
– We use a pretty minimal try/except so that if an index is out of bounds we print an error (this might happen if the coverage file is shorter than the genome).
This version avoids the pitfalls of trying to “map back” a match found in a reversed genome reference. It should correctly report the start and end of the promoter as well as the position of the uppercase (marker) nucleotide on either strand.
-
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.