It is simple, does not modify the base string,Īnd lends itself well to the nested parsing of different delimiters. Strtok incorrectly, and there may be better functions I should have used. Hi experts,Please advise about the following scenario:I want to tokenize a string based on whole word delimiter instead of character e.g. These may no longer be issues with strok, I have may have been using Making it difficult to re-parse, and that alternating between delimiters was I can only guess that it was because strtok changes the original string, if there's a delimiter following the last string).For reasons that now escape me, I stopped using strtok to parse strings inĬ. I'm going to assume you want each word, with its preceding and following delimiters, but NOT any strings of delimiters by themselves (e.g. It depends on whether you want the preceding delimiters, the following delimiters, or both, and what you want to do with strings at the beginning and end of the string that may not have delimiters before/after them. usr/local/bin fish > string split abc a b c > string split -allow-empty -f1,3,5 abc a c. Pos = strOne.find_first_of(delimiters, startpos) string-split - split strings by delimiter. Each character in the constructors delimiter field acts as one delimiter. Startpos = strOne.find_first_not_of(delimiters, pos) Below example shows how to break a string based on multiple delimiters. If( string::npos = strOne.find_first_not_of(delimiters, pos) ) if delimiter is a new line ( ) then addt new line VS.push_back(strOne.substr(startpos, pos - startpos)) If(strOne.substr(startpos, pos - startpos) != '') While (string::npos != pos || string::npos != startpos) Int pos = strOne.find_first_of(delimiters, startpos)

vector Tokenize(const string& strInput, const string& strDelims)

The idea is that you tell the tokenizer what string you want to split up and by what. Passed like so ' .n'So a comma, period, exclamation, and new line will be pushed into the vector as well, but not the space. Remember that in C, strings are nothing more than a character array.

I did not want to use boost since this is a school assignment and my instructor wanted me to use find_first_of to accomplish this. I edited my post to include all of the function.I see what you did, but the delimiters will be a string and each char in the string will be a delimiter. I now this a little sloppy, but this is what I ended up with.

C tokenize string delimiter