Error in read.table

[dashainparis]

Hello that it is me again! Thank you for the previous answer!

I have another question, I ran ExomeDel on my data and keep getting this error:

Error in read.table(file = file, header = header, sep = sep, quote = quote, :
no lines available in input
Calls: read.bigFile -> read.delim -> read.table
Execution halted

I definitely have a file to read it, I really do not get what am I doing wrong.

Thank you in advance!

Dasha

[dashainparis]

Ok, I think I found what is the error.

In readme for the gtf file you ask the following format:

#gtf file:
#Column1 ... Column3 Column4 Column5 ...
Chromosome ... exon StartPosition EndPosition ...

but actually in example folder for gtf file you have this format:

#bin name chrom strand txStart txEnd cdsStart cdsEnd exonCount exonStarts exonEnds score name2 cdsStartStat cdsEndStat exonFrames

and the code is written for the the second format, so the classical gtf file does not suit it.

Am I missing something, may be I should gtf download from somewhere else?

Thank you in advance!

Dasha

[pineapple216]

I experience the same error. @dashainparis did you had any success trying to run the program with a differently formatted gtf file as you suggested above?

UPDATE: I've tried to run ExonDel with a differently formatted .gtf file and I still get the same error.

[dashainparis]

Well, actually I did not succeeded to get to the end, but I had different type of error and I guess it is in my bam files.

I am not sure where can be downloaded exactly this format, but thought the uscs you can get this:

#name chrom strand txStart txEnd cdsStart cdsEnd exonCount exonStarts exonEnds proteinID alignID

I added the first column #bin just manually something like 0 everywhere (I've checked it is not used in the code).

[pineapple216]

I've run the program with a gtf file formatted the same as in the example and I get the same error.
The file I used as gtf file can be found here:

https://www.dropbox.com/s/59n4q8evtqwaicz/refGene.hg19.24feb2015ucsc.txt?dl=0

[dashainparis]

Thanks! Then I actually do not know, because it worked for me. But perl code is well written and very readable (well as it could be for perl), so good luck!

[pineapple216]

@dashainparis Did you manage to get it working?

[slzhao]

Hello Dasha and Koen,

You are right. The format of gft file in README is not correct. It was
copied from my another software and was not for ExonDel. The format of
example gtf file is correct. I will change the README file soon.

For the gtf files, You can download it from UCSC (
http://genome.ucsc.edu/cgi-bin/hgTables), and select track as RefSeq Genes.
The file can be used in ExonDel.

To Koen:
For the error message, it happened when reading files into R and I am not
sure if it was related with the gtf format.
I will fix it If you can send part of the files ("genesPassQCwithGC.bed"
and "genesPassQCwithGC.bed.depth") to me.

Thank you!

Best,
Shilin

2015-03-25 9:32 GMT-05:00 Dasha notifications@github.com:

Thanks! Then I actually do not know, because it worked for me. But perl
code is well written and very readable (well as it could be for perl), so
good luck!

—
Reply to this email directly or view it on GitHub
#2 (comment).

[pineapple216]

Dear Shilin,

I've checked the files you mentioned.

"genesPassQCwithGC.bed" is empty and "genesPassQCwithGC.bed.depth" contains the following:

DNA03-03099-BRCA1
DNA04-04960-BRCA1
DNA05-02178-BRCA1
DNA05-02206-BRCA1
DNA07-07992-BRCA1
DNA07-09019-BRCA1
DNA07-10821-BRCA1
DNA08-04752-BRCA1
DNA08-07116-BRCA1
DNA09-03624A-BRCA1
DNA09-08514-BRCA1
DNA09-13320A-BRCA1
DNA09-14933A-BRCA1

These are the sample names in my case.

Koen

[dashainparis]

Dear Shilin,

Thank you for the answer.

I actually managed to run the tool, but I had several obstacles on my way.

First is due the chromosomes names. Actually if you work with any human data you will have chr in the chromosome names, and at the same time you always have just number in other files, so easier you manually change all you data (which is a lot, and also it ruins other tools workflow), easier you change the code.

And second thing which took me a while to catch. Is that in bamList it is very strict according to the number of tubs. So I had two and it did not work at all.

But after all tool seems to work really good with my data, thank you for it!

Dasha

[pineapple216]

Dear Shilin,

Do you have an estimation how much time it will take to fix ExonDel?

Kind regards,

Koen Hendriks

[slzhao]

Hello Dasha,

For the first thing, do you mean I can change the code so that it can be
used for both chromosome "chr1" and "1"? Such kind of code exists for all
annotation files including gtf and bed, but I didn't add them to bam file
processing because that would be slow. I will add them to bam processing in
next version.
For the second thing, do you mean columns? You can only have bam file names
in the bam list file. which is only one column.

Please let me know if you have other questions.

Best,
Shilin

2015-03-30 3:43 GMT-05:00 Dasha notifications@github.com:

Dear Shilin,

Thank you for the answer.

I actually managed to run the tool, but I had several obstacles on my way.

First is due the chromosomes names. Actually if you work with any human
data you will have chr in the chromosome names, and at the same time you
always have just number in other files, so easier you manually change all
you data (which is a lot, and also it ruins other tools workflow), easier
you change the code.

And second thing which took me a while to catch. Is that in bamList it is
very strict according to the number of tubs. So I had two and it did not
work at all.

But after all tool seems to work really good with my data, thank you for
it!

Dasha

—
Reply to this email directly or view it on GitHub
#2 (comment).

[slzhao]

Hello Koen,

What about the genesPassQC.bed and covered_percentage file? Can you send me
part of them if they are not empty. I need to see some result files to know
how to fix it.

Best,
Shilin

2015-04-02 3:36 GMT-05:00 Koen Hendriks notifications@github.com:

Dear Shilin,

Do you have an estimation how much time it will take to fix ExonDel?

Kind regards,

Koen Hendriks

—
Reply to this email directly or view it on GitHub
#2 (comment).

[pineapple216]

Hello Shilin,

I've run ExonDel again and this is in my covered_percentage file:

#bin name om strand txStart txEnd cdsStart cdsEnd exonCount exonStarts exonEnds score name2 cdsStartStat cdsEndStat exonFrames coveredBP coveredExon
19 NM_001291929 11 - 89057521 89223909 89059923 89223852 17 89057521,89069012,89070614,89073230,89075241,89088129,89106599,89133184,89133382,89135493,89155069,89165951,89173855,89177302,89182607,89184952,89223774, 89060044,89069113,89070683,89073339,89075361,89088211,89106660,89133247,89133547,89135710,89155150,89166024,89173883,89177400,89182692,89185063,89223909, 0 NOX4 cmpl cmpl 2,0,0,2,2,1,0,0,0,2,2,1,0,1,0,0,0, 0.400434992750121 0.882352941176471
985 NM_016039 14 + 52456227 52471420 52456357 52471234 8 52456227,52458034,52460440,52465211,52466425,52468515,52470911,52471079, 52456418,52458159,52460540,52465298,52466514,52468584,52470960,52471420, 0 C14orf166 cmpl cmpl 0,1,0,1,1,0,0,1, 0.768649669499528 1
858 NM_006739 22 + 35796115 35820495 35796431 35820248 17 35796115,35796423,35799199,35799406,35802545,35804400,35806736,35808502,35809867,35811821,35812331,35812630,35813736,35815876,35817310,35819206,35820146, 35796201,35796598,35799326,35799535,35802718,35804556,35806903,35808674,35809979,35811965,35812397,35812807,35813849,35816005,35817453,35819334,35820495, 0 MCM5 cmpl cmpl -1,0,2,0,0,2,2,1,2,0,0,0,0,2,2,1,0, 0.873195474053843 0.941176470588235
1761 NM_032385 5 - 154198051 154230213 154199875 154217738 9 154198051,154200819,154202031,154202946,154210360,154214184,154214402,154217690,154230042, 154200032,154200986,154202137,154203152,154210482,154214288,154214494,154217738,154230213, 0 FAXDC2 cmpl cmpl 2,0,2,0,1,2,0,0,-1, 0.349634065202928 0.888888888888889
587 NM_021034 11 - 319672 320914 319837 320813 2 319672,320564, 319990,320914, 0 IFITM3 cmpl cmpl 0,0, 0.749253731343284 1
1162 NM_020932 X + 75648045 75651746 75648323 75651197 1 75648045, 75651746, 0 MAGEE1 cmpl cmpl 0, 0.809832522960562 1
13 NM_020929 11 - 40135750 41481186 40135919 40137842 5 40135750,40162350,40341177,40669691,41480980, 40137884,40162403,40341271,40669828,41481186, 0 LRRC4C cmpl cmpl 0,-1,-1,-1,-1, 0.769874476987448 0.2
1352 NM_021029 X + 100645877 100651142 100645923 100650736 5 100645877,100646446,100646742,100650322,100650715, 100646034,100646552,100646810,100650445,100651142, 0 RPL36A cmpl cmpl 0,0,1,0,0, 0.488713318284424 1
1688 NM_032378 8 - 144661866 144679845 144661961 144672251 10 144661866,144662181,144662675,144663223,144663398,144668388,144668898,144671160,144672777,144679517, 144662000,144662376,144662897,144663324,144663498,144668460,144669022,144672251,144672908,144679845, 0 EEF1D cmpl cmpl 0,0,0,1,0,0,2,0,-1,-1, 0.80622009569378 0.8
106 NR_002833 7 - 35120898 35225774 35225774 35225774 22

genesPassQC.bed contains the following±

14 52456227 52456418 C14orf166 NM_016039
14 52458034 52458159 C14orf166 NM_016039
14 52460440 52460540 C14orf166 NM_016039
14 52465211 52465298 C14orf166 NM_016039
14 52466425 52466514 C14orf166 NM_016039
14 52468515 52468584 C14orf166 NM_016039
14 52470911 52470960 C14orf166 NM_016039
14 52471079 52471420 C14orf166 NM_016039
11 319672 319990 IFITM3 NM_021034
11 320564 320914 IFITM3 NM_021034
X 75648045 75651746 MAGEE1 NM_020932
X 100645877 100646034 RPL36A NM_021029
X 100646446 100646552 RPL36A NM_021029
X 100646742 100646810 RPL36A NM_021029
X 100650322 100650445 RPL36A NM_021029
X 100650715 100651142 RPL36A NM_021029
19 48373722 48374824 SULT2A1 NM_003167
19 48377913 48378091 SULT2A1 NM_003167
19 48382292 48382387 SULT2A1 NM_003167
19 48385340 48385467 SULT2A1 NM_003167
19 48386833 48387042 SULT2A1 NM_003167
19 48389378 48389654 SULT2A1 NM_003167
1 26856248 26856474 RPS6KA1 NM_002953
1 26863415 26863460 RPS6KA1 NM_002953
1 26873357 26873474 RPS6KA1 NM_002953
1 26873679 26873761 RPS6KA1 NM_002953
1 26877887 26877968 RPS6KA1 NM_002953
1 26878134 26878214 RPS6KA1 NM_002953
1 26879881 26879988 RPS6KA1 NM_002953
1 26880704 26880742 RPS6KA1 NM_002953
1 26881086 26881229 RPS6KA1 NM_002953
1 26881641 26881712 RPS6KA1 NM_002953
1 26882027 26882116 RPS6KA1 NM_002953
1 26883144 26883209 RPS6KA1 NM_002953
1 26883488 26883591 RPS6KA1 NM_002953
1 26885297 26885428 RPS6KA1 NM_002953
1 26887216 26887342 RPS6KA1 NM_002953
1 26887535 26887625 RPS6KA1 NM_002953
1 26887995 26888154 RPS6KA1 NM_002953
1 26897939 26898101 RPS6KA1 NM_002953
1 26898339 26898416 RPS6KA1 NM_002953
1 26898666 26898784 RPS6KA1 NM_002953
1 26899714 26899852 RPS6KA1 NM_002953
1 26900569 26901520 RPS6KA1 NM_002953
20 36932551 36932755 BPI NM_001725
20 36935968 36936083 BPI NM_001725
20 36937331 36937460 BPI NM_001725
20 36938892 36939054 BPI NM_001725
20 36940275 36940339 BPI NM_001725
20 36946814 36946878 BPI NM_001725
20 36948584 36948676 BPI NM_001725
20 36952271 36952448 BPI NM_001725
20 36953175 36953235 BPI NM_001725
20 36954666 36954834 BPI NM_001725
20 36955989 36956057 BPI NM_001725
20 36959449 36959492 BPI NM_001725
20 36962831 36962895 BPI NM_001725
20 36963999 36964076 BPI NM_001725
20 36965547 36965905 BPI NM_001725
16 11361713 11361869 TNP2 NM_005425
16 11362719 11363160 TNP2 NM_005425
11 120973374 120973438 TECTA NM_005422
11 120976539 120976673 TECTA NM_005422
11 120979919 120980207 TECTA NM_005422
11 120983780 120983918 TECTA NM_005422
11 120984261 120984427 TECTA NM_005422
11 120989014 120989427 TECTA NM_005422
11 120996010 120996581 TECTA NM_005422
11 120998460 120999053 TECTA NM_005422
11 121000346 121000920 TECTA NM_005422
11 121008129 121008731 TECTA NM_005422
11 121016263 121016825 TECTA NM_005422
11 121023589 121023789 TECTA NM_005422
11 121028549 121028933 TECTA NM_005422
11 121030843 121031130 TECTA NM_005422
11 121032783 121033079 TECTA NM_005422
11 121035981 121036092 TECTA NM_005422
11 121037286 121037489 TECTA NM_005422
11 121038762 121038926 TECTA NM_005422
11 121039385 121039634 TECTA NM_005422
11 121058540 121058703 TECTA NM_005422
11 121059788 121059876 TECTA NM_005422
11 121060472 121060589 TECTA NM_005422
11 121061414 121061515 TECTA NM_005422
19 10218326 10218411 SNORD105 NR_004381
17 62223437 62223517 SNORD104 NR_004380
X 109468216 109468288 SNORD96B NR_004379
2 86362992 86363129 SNORD94 NR_004378
1 231762560 231762680 DISC1 NM_001164555
1 231829571 231830551 DISC1 NM_001164555
1 231885671 231886365 DISC1 NM_001164555
16 5094122 5094479 C16orf89 NM_001098514
16 5097878 5097965 C16orf89 NM_001098514
16 5105246 5105351 C16orf89 NM_001098514
16 5106053 5106189 C16orf89 NM_001098514
16 5108493 5108611 C16orf89 NM_001098514
16 5110286 5110437 C16orf89 NM_001098514
16 5112425 5112575 C16orf89 NM_001098514
16 5115701 5116146 C16orf89 NM_001098514

If you need other information or more data, please don't hesitate to contact me.

Bests,

Koen

[slzhao]

Hello Koen,

I checked your results and found that: the "genesPassQC.bed" file was right
but the "genesPassQCwithGC.bed" was not correct. So the problem should be
in GC content calculation.
And I think the problem is the different chromosome formats in gtf and
fasta file. Your gtf files may have chromosome format like "chr1", while
your fasta file have chromosome format like "1". That's the problem.

I've updated ExonDel to version 1.01 which can handle different
formats of chromosome.
Would you please try that version and I think it will work.

Please let me know if you have any other questions. Thank you!

Best,
Shilin

2015-04-07 4:06 GMT-05:00 Koen Hendriks notifications@github.com:

Hello Shilin,

I've run ExonDel again and this is in my covered_percentage file:

#bin name om strand txStart txEnd cdsStart cdsEnd exonCount exonStarts
exonEnds score name2 cdsStartStat cdsEndStat exonFrames coveredBP
coveredExon
19 NM_001291929 11 - 89057521 89223909 89059923 89223852 17
89057521,89069012,89070614,89073230,89075241,89088129,89106599,89133184,89133382,89135493,89155069,89165951,89173855,89177302,89182607,89184952,89223774,
89060044,89069113,89070683,89073339,89075361,89088211,89106660,89133247,89133547,89135710,89155150,89166024,89173883,89177400,89182692,89185063,89223909,
0 NOX4 cmpl cmpl 2,0,0,2,2,1,0,0,0,2,2,1,0,1,0,0,0, 0.400434992750121
0.882352941176471
985 NM_016039 14 + 52456227 52471420 52456357 52471234 8
52456227,52458034,52460440,52465211,52466425,52468515,52470911,52471079,
52456418,52458159,52460540,52465298,52466514,52468584,52470960,52471420, 0
C14orf166 cmpl cmpl 0,1,0,1,1,0,0,1, 0.768649669499528 1
858 NM_006739 22 + 35796115 35820495 35796431 35820248 17
35796115,35796423,35799199,35799406,35802545,35804400,35806736,35808502,35809867,35811821,35812331,35812630,35813736,35815876,35817310,35819206,35820146,
35796201,35796598,35799326,35799535,35802718,35804556,35806903,35808674,35809979,35811965,35812397,35812807,35813849,35816005,35817453,35819334,35820495,
0 MCM5 cmpl cmpl -1,0,2,0,0,2,2,1,2,0,0,0,0,2,2,1,0, 0.873195474053843
0.941176470588235
1761 NM_032385 5 - 154198051 154230213 154199875 154217738 9
154198051,154200819,154202031,154202946,154210360,154214184,154214402,154217690,154230042,
154200032,154200986,154202137,154203152,154210482,154214288,154214494,154217738,154230213,
0 FAXDC2 cmpl cmpl 2,0,2,0,1,2,0,0,-1, 0.349634065202928 0.888888888888889
587 NM_021034 11 - 319672 320914 319837 320813 2 319672,320564,
319990,320914, 0 IFITM3 cmpl cmpl 0,0, 0.749253731343284 1
1162 NM_020932 X + 75648045 75651746 75648323 75651197 1 75648045,
75651746, 0 MAGEE1 cmpl cmpl 0, 0.809832522960562 1
13 NM_020929 11 - 40135750 41481186 40135919 40137842 5
40135750,40162350,40341177,40669691,41480980,
40137884,40162403,40341271,40669828,41481186, 0 LRRC4C cmpl cmpl
0,-1,-1,-1,-1, 0.769874476987448 0.2
1352 NM_021029 X + 100645877 100651142 100645923 100650736 5
100645877,100646446,100646742,100650322,100650715,
100646034,100646552,100646810,100650445,100651142, 0 RPL36A cmpl cmpl
0,0,1,0,0, 0.488713318284424 1
1688 NM_032378 8 - 144661866 144679845 144661961 144672251 10
144661866,144662181,144662675,144663223,144663398,144668388,144668898,144671160,144672777,144679517,
144662000,144662376,144662897,144663324,144663498,144668460,144669022,144672251,144672908,144679845,
0 EEF1D cmpl cmpl 0,0,0,1,0,0,2,0,-1,-1, 0.80622009569378 0.8
106 NR_002833 7 - 35120898 35225774 35225774 35225774 22

genesPassQC.bed contains the following±

14 52456227 52456418 C14orf166 NM_016039
14 52458034 52458159 C14orf166 NM_016039
14 52460440 52460540 C14orf166 NM_016039
14 52465211 52465298 C14orf166 NM_016039
14 52466425 52466514 C14orf166 NM_016039
14 52468515 52468584 C14orf166 NM_016039
14 52470911 52470960 C14orf166 NM_016039
14 52471079 52471420 C14orf166 NM_016039
11 319672 319990 IFITM3 NM_021034
11 320564 320914 IFITM3 NM_021034
X 75648045 75651746 MAGEE1 NM_020932
X 100645877 100646034 RPL36A NM_021029
X 100646446 100646552 RPL36A NM_021029
X 100646742 100646810 RPL36A NM_021029
X 100650322 100650445 RPL36A NM_021029
X 100650715 100651142 RPL36A NM_021029
19 48373722 48374824 SULT2A1 NM_003167
19 48377913 48378091 SULT2A1 NM_003167
19 48382292 48382387 SULT2A1 NM_003167
19 48385340 48385467 SULT2A1 NM_003167
19 48386833 48387042 SULT2A1 NM_003167
19 48389378 48389654 SULT2A1 NM_003167
1 26856248 26856474 RPS6KA1 NM_002953
1 26863415 26863460 RPS6KA1 NM_002953
1 26873357 26873474 RPS6KA1 NM_002953
1 26873679 26873761 RPS6KA1 NM_002953
1 26877887 26877968 RPS6KA1 NM_002953
1 26878134 26878214 RPS6KA1 NM_002953
1 26879881 26879988 RPS6KA1 NM_002953
1 26880704 26880742 RPS6KA1 NM_002953
1 26881086 26881229 RPS6KA1 NM_002953
1 26881641 26881712 RPS6KA1 NM_002953
1 26882027 26882116 RPS6KA1 NM_002953
1 26883144 26883209 RPS6KA1 NM_002953
1 26883488 26883591 RPS6KA1 NM_002953
1 26885297 26885428 RPS6KA1 NM_002953
1 26887216 26887342 RPS6KA1 NM_002953
1 26887535 26887625 RPS6KA1 NM_002953
1 26887995 26888154 RPS6KA1 NM_002953
1 26897939 26898101 RPS6KA1 NM_002953
1 26898339 26898416 RPS6KA1 NM_002953
1 26898666 26898784 RPS6KA1 NM_002953
1 26899714 26899852 RPS6KA1 NM_002953
1 26900569 26901520 RPS6KA1 NM_002953
20 36932551 36932755 BPI NM_001725
20 36935968 36936083 BPI NM_001725
20 36937331 36937460 BPI NM_001725
20 36938892 36939054 BPI NM_001725
20 36940275 36940339 BPI NM_001725
20 36946814 36946878 BPI NM_001725
20 36948584 36948676 BPI NM_001725
20 36952271 36952448 BPI NM_001725
20 36953175 36953235 BPI NM_001725
20 36954666 36954834 BPI NM_001725
20 36955989 36956057 BPI NM_001725
20 36959449 36959492 BPI NM_001725
20 36962831 36962895 BPI NM_001725
20 36963999 36964076 BPI NM_001725
20 36965547 36965905 BPI NM_001725
16 11361713 11361869 TNP2 NM_005425
16 11362719 11363160 TNP2 NM_005425
11 120973374 120973438 TECTA NM_005422
11 120976539 120976673 TECTA NM_005422
11 120979919 120980207 TECTA NM_005422
11 120983780 120983918 TECTA NM_005422
11 120984261 120984427 TECTA NM_005422
11 120989014 120989427 TECTA NM_005422
11 120996010 120996581 TECTA NM_005422
11 120998460 120999053 TECTA NM_005422
11 121000346 121000920 TECTA NM_005422
11 121008129 121008731 TECTA NM_005422
11 121016263 121016825 TECTA NM_005422
11 121023589 121023789 TECTA NM_005422
11 121028549 121028933 TECTA NM_005422
11 121030843 121031130 TECTA NM_005422
11 121032783 121033079 TECTA NM_005422
11 121035981 121036092 TECTA NM_005422
11 121037286 121037489 TECTA NM_005422
11 121038762 121038926 TECTA NM_005422
11 121039385 121039634 TECTA NM_005422
11 121058540 121058703 TECTA NM_005422
11 121059788 121059876 TECTA NM_005422
11 121060472 121060589 TECTA NM_005422
11 121061414 121061515 TECTA NM_005422
19 10218326 10218411 SNORD105 NR_004381
17 62223437 62223517 SNORD104 NR_004380
X 109468216 109468288 SNORD96B NR_004379
2 86362992 86363129 SNORD94 NR_004378
1 231762560 231762680 DISC1 NM_001164555
1 231829571 231830551 DISC1 NM_001164555
1 231885671 231886365 DISC1 NM_001164555
16 5094122 5094479 C16orf89 NM_001098514
16 5097878 5097965 C16orf89 NM_001098514
16 5105246 5105351 C16orf89 NM_001098514
16 5106053 5106189 C16orf89 NM_001098514
16 5108493 5108611 C16orf89 NM_001098514
16 5110286 5110437 C16orf89 NM_001098514
16 5112425 5112575 C16orf89 NM_001098514
16 5115701 5116146 C16orf89 NM_001098514

If you need other information or more data, please don't hesitate to
contact me.

Bests,

Koen

—
Reply to this email directly or view it on GitHub
#2 (comment).

[pineapple216]

Hi Shilin,

Today I've tried running ExonDel v1.04.
It unfortunately still gives an error.

The ExonDel.rLog file contains the following:

Error in read.table(file = file, header = header, sep = sep, quote = quote, :
no lines available in input
Calls: read.bigFile -> read.delim -> read.table
Execution halted

Hopefully you can shed some light on this.

Bests,

Koen