check SID0004 - paragraph #20 didn't break -- question mark issue? - solve the mystery as to why?

[turnkit]

Can you double check the output of SID0004.mp3.txt_out.txt?

I mean -- can you run the process on your local machine and see if it chunks the same way as this one?

The twentieth paragraph seems to have stopped adding new paragraphs.  

I'm noticing this paragraph ends in a question mark. So I am wondering if the issue might be related to the question mark.

Can you run it from the source and if you get the same output, change the ? to a period and run it again to see if the same output comes up.

(If there's an issue with the question marks see if you can fix it. If this issue is not question mark related maybe try tweaking some , and look carefully at the source file, to see if you can figure out why this paragraph refused to chunk.)

This is only an issue if we find that many other files are not properly chunking.

If we see any more of these we should probably add to the list a python script to run stats on each file so we can qualify the quality of the output.

Such a utility would be useful regardless of how quickly you can resolve this. It would "just" log the file name for each chunked (paragraph added) file and also show: sentence count for the paragraph with the FEWEST sentences (a number), the average number of sentences for each paragraph, the number of sentences in the paragraph with the MOST number of sentences. These stats should be comma delimited so that the file imports into a spreadsheet for analysis and potential metadata import into the hosting system.

I'll add this utility request as a unique issue.

SID0004.mp3.txt_out.txt

We shall read again the two passages around which much of our meditation has suckled at this time, and then we shall add to them a third fragment. First is in the first letter of Peter, chapter one, verse three. Blessed be the God and Father of our Lord Jesus Christ, who according to his great mercy begat us again unto a living hope by the resurrection of Jesus Christ from the dead, unto an inheritance incorruptible and undefiled, and that faded not away, reserved in heaven. Living hope by the resurrection of Jesus Christ from the dead. The letter to the Colossians, chapter one, and verse twenty-seven, God was pleased to make known what is the riches of the glory of this mystery among the nations, which is Christ in you, the hope of glory. Living hope by the resurrection of Jesus Christ, Christ in you, the hope of glory. Now this fragment from a very considerable setting in the sixth chapter of the Gospel by John, verse thirty-three, for the bread of God is He which cometh down out of heaven and giveth life unto the world. Just the small phrase, the bread of God, Christ in you, the hope of glory. It is possible that you have been impressed as I have with the fact that throughout the Bible from beginning to end, feeding has such a large place.

And we'll have discovered that with great pleasure, others of us perhaps are not so pleasantly surprised that it is so. But there it is, seems that the first thought of God for man after having created him was like his food, everything for food is the word, and on from that point, so matter of eating and drinking develops tremendously. All the great religious convocations in Israel were mainly characterized by this feasting element, they were feasts of the Lord. And everything in relation to the Lord, and in the Lord's relationship to man, in the Old Testament, seemed to be centered around this matter of eating and drinking. But there's not a little in the gospels about it. Some of the parables, the parables of feasts. And we can be quite sure of this, that inasmuch as so largely by the instigation, instruction, prescription of the Lord, his thought never ended with a merely physical temporal.

The gratification of natural desire and appetite. We can be quite sure that that, of all that, there is a spiritual thought and an eternal thought. And it looks very much as though John 6 brings it right in, in fullness, for it's so very largely a long chapter on the bread of life, Christ the bread of life, feeding, drinking, as he said, his blood and eating his flesh. Now bread, as we quite well know, is a town, it's a town which everywhere is synonymous with the stable food of life.

Some countries it is not, it is not what we call bread, but to everybody, whatever the form is, it is this or that, it is bread, that is, it is the very basis of existence. It is not a great distance from the symbol and the temporal to the spiritual. The very subsistence of life, the very basis of life is Christ in you. That is the deepest meaning of the Lord's table. The eating and the drinking is symbolic of this one thing, Christ in you, Christ becoming your very invulnerable basis of existence.

That's the principle. Now as in so many other things, Israel is a great illustration of this great truth. For Israel's life and history had three aspects, every one of which was based upon food.

The very beginning was the pasta of a meal, the eating of the pasta. There sat down in the wilderness or there's journeys through the wilderness based upon the manner. And when they came into the land, it says, and when they had eaten of the old corn of the land, the manner ceased, a new phase but still this governing factor of bread, of food.

Those three phases of Israel's life are in figure, the three phases of every Christian's life, the life of the church, the life of any company of believers. There is that which answers to or is typical of the Passover. The very foundation of our being, the Lord's people, is in the Passover.

We know that it was foundational to their national history. It was in the eating of the Passover on that night ever to be remembered that their deliverance from the power of this world, their deliverance from the old bondage to its tyranny. Their deliverance from all the defeat and frustration of that old life realm. Their emergence to become the Lord's people, in covenant by Him in blood. All that was centered in the eating of the Passover, their salvation rested upon their eating of the Passover. That night bondage was broken and death destroyed for them or nullified for them. They didn't escape and they were constituted the nation of God, the Lord's people, his own possession by eating the Passover lamb.

And that became an institution throughout all their generations, the Passover was an annual event as we know, meaning that it governed all their years and all their generations. Stands to this day in Israel and always in relation to what happened at the beginning, a feeding. You may think that that is simple and elementary, but dear friends, it does make a difference to us what we eat. It makes a lot of difference what we eat. What are you feeding on?

It will show itself in your face. If you are feeding upon yourself, your miserable, wretched self, that self that is not redeemed and cannot be redeemed and God never intended to redeem it, that sinful self, which He never catches up or repairs. If you are feeding on yourself, well no wonder you're miserable, it's poor fare, isn't it?

When you go to prayer, fasting in the morning, I take it that you do, what do you feed on? All the time telling the Lord what a wretched thing you are, the miserable thing you are, what a failure you are. You can't give the Lord any new information about that.

There's more power, far more about that than you could ever tell Him. No wonder you begin the day in defeat. If feeding on food that is not convenient, Christ our Passover has been sacrificed. Feeding upon the very elements and constituents of redemption, of salvation, Christ crucified. That's the way to start any day.

There are many other things that you might be feeding on, not only in the morning but through the day and through all the week, on some grievance, some offense, some trouble that you're nursing, something you're feeding on it, isn't it your daily food? You don't get very far in the Christian life until the foundation, the provision of God, is your daily meal. Like that, I say it does make a difference what we feed on. Well there was the first phase, you see, there was a mighty phase, but it was basic to everything else, basic to everything else, and eating of that which represented and symbolized the completeness and perfection of our redemption in Christ Jesus, the finished work, the mighty deliverance from the power of the enemy and of the world. And of our spiritual bonding, oh let us feed on it more. If we did, we'd be far more triumphant to people if we would feed on that first aspect of God's provision. Look at Israel in Egypt, what's the picture?

In our press and the depressed people, in shame, in disappointment, just in everything that was not glorious, but the opposite to what is glorious, what a picture. We don't have to look back to Israel in Egypt to see the picture, we know how true in the spiritual life that state is without Christ, but from that despair, and God saw to it that they did reach the point of utter despair, from that despair, and that shame, and that reproach, and that everything so contrary to glory, the hope of glory sprang when they fed on the Lamb, when they took Him inside, Christ in you, the hope of glory right at the beginning to change everything, like that. The second phase, there in the wilderness, redemption has been effected, they are out as the Lord's own people, but now this phase has its own particular and peculiar features and characteristics, they are at school, under discipline, learning the deep and drastic lessons of a walk of faith with God.

Very hard school, for it is a life of faith indeed, there is nothing for sight in a wilderness that you can find any hope in, nothing there that will grow of itself or that you, by any effort of yours, could make to grow, you are cast upon God for everything, you've got to learn right from the beginning, all the way along that God and God alone is your resource, God is your resource, with every element against you, with every difficulty around you, with everything that speaks of desolation on the outside and hopelessness, by daily lessons of testing and trial, learning this one thing that God can meet the situation, God is sufficient for this, He is the only recourse, but He is the recourse. The manner signifies that, when they first saw the manner, they said, what is it? That's a poor translation of the original language, which can hardly be translated. If we were to try to put it into a phrase, it would be difficult to do so, but with something like this, this is a mystery.

What is it? We've never, never seen anything like this before, never known of anything like this, there's nothing within the whole compass of our natural knowledge that explains this. It's a mystery, it's something quite strange, it's something from outside of this world. That was the manner, the sustenance of the Lord's people in all that which corresponds to the wilderness discipline and chastening and training and trial, I say the sustenance through it all is a mystery.

How you and I have gone on through the years with everything calculated to destroy faith, to undermine confidence, to shake us and to destroy us, how we've gone on, it's a mystery, but that's manner. It is that marvelous, though so mysterious, unsurpassable, inexplicable ministry of Christ where we can do nothing about it at all. It's like that, they couldn't do anything, what could they do to get food in the wilderness? They could do nothing, it's no use plowing and sowing in its desert, nowhere to go for anything.

What could they do, could do nothing and yet all this is on them of demand, demand and they can do nothing about it. What can we do today? What can we do in this situation which is a part of our spiritual education and training to know the Lord, to prove the Lord, what can we do, we can do nothing.

That's just the truth, isn't it, about so much of the Christian life, you can't do anything about it. How we look around, search and explore for some way of being able to solve the problem, we shut up it, we shut up to God and we've come through powers and experiences like that and there was no way and no record, no solution, no answer and nothing that we could do. The mystery of Christ in you, the hope, we've come on. You could have no more hopeless situation than a desert, have you ever seen a desert? I've passed over that very same desert many times, my word, it brings it home to you. People should be in that for forty years and survive, no water, no food, the mystery.

That is the hope in such a situation. Christ in you, the bread of God, the bread of God, not of man. Of course a very great deal of all this was, while necessary training and discipline, a very great deal of it was due to themselves, due to themselves, their own folk shall we say. And we're all going to be perfectly candid and frank about this, a great deal about trouble is our own fault, but thank God, though it was so much their own fault, he didn't say, it's your own fault, I'll leave you to it, he gave the manner out of heaven. See, the Lord from his side didn't intend that, when they were leaving Egypt, he told them to take victorials, and their needing troughs, what's the good of a needing trough in a desert, this, that it was only from the divine standpoint an eleven days journey to the land, but it extended to forty years, and due to their fault, the Lord did not intend it to be like that, but you know, there's so much in our lives the Lord never intended, but what I'm coming down on all the time is this, oh yes, let that be trough, fully trough, and how many of us today have to say, oh, I had my time over again, with the knowledge that I had today, I wouldn't do that, I wouldn't do that, I would do other, I see where I made the mistake, where I involved myself in difficulty, where I made confusion and a mess of things, but the Lord never abandoned us, as he never abandoned them, thank God, he gave the manner out of heaven, he still sustained them with this mysterious sustenance that they knew not of, they could not explain, but there it was, second phase, they did have to learn very much, and learn in a hard school, but the Lord provided the sustenance for that phase, third phase, they pass into the land eventually, or the next generation, they pass into the land, and as I have said, in Joshua 5 it says, and when they had eaten of the old corn of the land, the man has eaten. Now, I want you to note this before you do that far, these other two phases are not left behind, something done forever, the Passover was maintained all the time, year by year, you've always, dear friends, right to the very end of your history with God, got to reckon on and stand into all the values of that Passover, that is not something just done and left, you and I will right to the end have to stand upon the infinite virtue of the body and blood of Christ, so the Passover is an ordinance forever in Israel, and even though they left the wilderness and the manner behind, they took a part of it over with them, in the ark, it is there still as a testimony, right at the heart of their life, in its changing aspects and phases, nevertheless, right at the center, in the ark, there's this part of manner, a testimony to how God can furnish a table in the wilderness, great thing to have that in the background of your life, if you hadn't, you couldn't go through this next phase, for when you come to the third phase in their life and history, it's the phase of tremendous responsibility, up to that time it has all been what the Lord has done for them, now it's going to be what the Lord will do through them, they're involved now, not in the kindergarten or childhood education period, they're now in the maturity-responsibility phase, there's warfare, continuous, desperate warfare on, it's another phase, now all that has been by way of provision, instruction, teaching and education has got to be put to the test in practical ways, what's the value of it now, you're up against it now, it is not the matter of your salvation now, it's a matter of your testimony before principalities and powers, your testimony before the world nations, now it's something tremendous that's on hand, firstly the warfare with the adverse, the antagonistic forces, then the taking possession of the inheritance, the mighty wealth, and then the turning of that inheritance, that which you have come into turning it and exploiting it, making it serve divine purpose, out of whose hills you can dig brass, there's some hard work to be done to exploit the resources that you've come into, to make good the values of the inheritance, we've graduated now from being the irresponsible people of the wilderness, to being the responsible people in fellowship with God in His great purpose, for this is a change in the food situation, now you've got to be very careful that you mark the real point of the change, before it was always the appropriation of faith, they went out every morning to appropriate by faith God's provision for the day, and while they observed the laws of that provision and were obedient to what the Lord said about it, that it was to be day by day and none left over for tomorrow, while they were obedient, faith made good God's provision, it is not a change from faith to something else when you get into the third phase, but it's a change of faith, it's a change of faith, then it was faith appropriating, receiving, taking, getting, now it's the works of faith, it's faith working, you've learned something about faith by the Lord's wonderful goodness to you, have you noticed how in the Christian life so often, not invariably because it seems sometimes the Lord hastens things by shortening the time and making it very intense for some young Christians, but have you not noticed that very often young Christians are treated like children and given so much of the Lord at the beginning, it seems to be made so easy for them, he almost seems to pander to them, spoil them, they have a wonderful time, they don't get to ask and they get it, is it like that, yes, it's just as we call it simple childlike faith, and the Lord responds to that at the beginning, but there comes a point at which it changes, not from faith, but where you have got to fight, the fight of faith, you're in the land, there's a battle on, tremendous battle, it's the fight now of faith, so it is not just that simple thing that it was, we must preserve, we must preserve that simple appropriating faith where our salvation is concerned, our continuous salvation, take that, take that simply by faith, but we need something more as we go on, we're involved in tremendous things, this conflict with the evil powers, forces, there's now something that we've got to do about all these resources that are ours in Christ, we just do not find that they're coming to us, we are put through exercise, through, yes, exercise, we have to do some real speed work now to turn to good, that which is our inheritance, do you follow?

If you don't understand the teaching, you know it in experience, it's like that, it is that changed aspect of faith because of a changed position, it is not now just salvation, I don't mean by that, that salvation's a little thing, do you know what I mean? Not just our acceptance that we are made children of God, it's not that, we are in a mighty, mighty thing in this universe, we're out of Romans, we're into Ephesians, we are in a mighty, mighty thing, in this universe, we're out of Romans, we're into Ephesians, we're in the mighty things, the deep things, the deep things of God, and in these things we only turn our resources to account by some very, very hard work, shall I put that another way by really being put to it? Now, are we going to know the power of His resurrection? My word to know that, we've got to know something very deeply of the power of death.

Are we going to come back to our theme? Are we going to know the wonder of the hope, the hope, which is Christ in us, the hope of glory, we'll taste something of despair to discover it, we'll be plunged sometimes, oh yes, you say that, that's terrible, but listen, listen to your favorite apostle, we despair even of life. Paul? Paul?

You say you despair, yes, I despair, and I've written it down that I despair. We had the sentence that it was death, that we should not trust in ourselves, but if God will raise it for death, you're going to know that kind of raising, you've got to know something of that kind of experience. But you see, Paul was not just there circling around his own personal salvation. His context is, I fill out that which is lacking of the sufferings of Christ for his body's sake, which is the church. I don't mean that that's the context in his writings, I mean that that's the spiritual context. His sufferings, his deep places, his being put to it to tremendous spiritual exercise of faith is not just personal, it's related, it's connected with the church and the church is destiny. When you get over into the land, things cease to be merely personal. It's the responsibility of the whole purpose and people of God.

But Christ in you is the hope of glory even there. It's very true. Whatever is true, and it is very true, about our salvation by appropriating Christ and about our sustenance in the Christian life through the years by simply feeding upon Him, taking Him from day to day as our life, as our strength.

There is true about that. It is equally true, I could almost say more true in this realm, where it's not because of our responsibility at all, it's not our fault, not because of what we have done or not done, nothing to do with our merely human weakness and faultiness and error and wrong. We are involved in something objective, a tremendous thing. No, this battle rages, and there's no explanation for many of the situations into which we are brought, many of the ordeals, there's no explanation in the realm of our own faultiness, our sinfulness.

It is not because of something that we have done or not done that this situation arises, it arises altogether apart from us, and we are thrust into it, become a part of it. It's something immense, far beyond the individual, the personal. It's related to the Lord's people everywhere in this world. But here I was saying, the marvel, the marvel of that provision of the Lord, Christ in you, the hope of glory even in that, in that, when all the forces of evil are let loose, when all the fire of the enemy is released, when we are in this great battle of the ages in the heavenlies, Christ in you is the hope of glory. See, that's the point upon which Paul finishes in that very letter which brings this third phase of Christian life so fully into view, glory in the church, and in Christ Jesus, unto all ages, and therefore ever and ever, why glory in the church, how glory in the church, Christ in you, the hope of glory, Christ in the church, His presence makes everything possible for an issue of glory.

Well, what have we said? We have simply pointed out with all these words and in these illustrative ways how God has made Christ. He bases the foundation of eternal glory and that by Christ being within.

O, take him, appropriate him, day by day, stand on him as the basis of your salvation, not on yourself. Don't feed on yourself. Don't feed on yourself, on your failure, on what you are if you do, you know, you know you're feeding upon ashes. God has made ashes of us all in the great altar.

Don't feed on ashes. Feed on Christ, the living Christ. Under discipline, trial, training, training and chastening and education, learning the lessons of faith. Feed on Christ, take him, take him in every time of faith trial and in the great battle in which we are, we find ourselves from a certain point in the Christian life. Thank God it is not left to us, not left to us to get through like that.

I did drop a word just now which might be helpful if I were to come back to it. I said in some cases it does seem that the Lord is saving a lot of time by pressing into a short period, the intensity of this training and trial. You can see some young Christians having the trial of mature Christians, having the discipline, the hard schooling that we would think should only come to those who have a lot of experience, but there it is.

Maybe you're one of those. Lord is shortening the time to get you matured quickly for some purpose. You will be able to take responsibility early, early.

Why wait? Because you've had years and years of Christian life before. You're able to take serious responsibility in the battle and in the corporate life of Lord's people. It's not necessary that there are great many people you know, unfortunately and tragically, a vast number of Christians today who will not face or contemplate any difficulty. They're going to have a good time. They're going to turn Christian life and Christianity into a continuous picnic, a continuous holiday, making it all a matter of pleasure, a measure. Well, they'll break if ever they get into the battle.

Well, they'll be scattered ever. They should have to face something of the third stage of the Christian life. It's not the Lord's unkindness to put any young Christian into a hard school.

It's that he might trust them with large responsibilities and do it early. It's a grand thing to see a young Christian, a young Christian, an old Christian. You know what I mean? One who really now can stand up to things and doesn't have to be nuts like a babe. One who can show the responsibilities in the house of God that does not all the time got to be chased after and looked up and cuddled now. But to be such, to be such, it's always this way. It's a difficult school, a difficult school. But the point is that for every phase and aspect, Christ is the bread of God, the bread of God, Christ in you, the hope.