Is there a way to detect string/letter not compatible with windows-1252 encoding?

Hi,

Is there a way to detect string/letter not compatible with windows-1252 encoding And then remove them?

Answer 1

[Walter Roberson]

Yes. When you unicode2native a character that has no counterpart in the destination character set, then binary 26 is substituted.

S = char(['How now?', 2000:2029, ' brown cow'])

S = 'How now?ߐߑߒߓߔߕߖߗߘߙߚߛߜߝߞߟߠߡߢߣߤߥߦߧߨߩߪ߫߬߭ brown cow'

B = unicode2native(S, 'windows-1252')

B = 1×48

72 111 119 32 110 111 119 63 26 26 26 26 26 26 26 26 26 26 26 26 26 26 26 26 26 26 26 26 26 26

B(B == 26) = []

B = 1×18

72 111 119 32 110 111 119 63 32 98 114 111 119 110 32 99 111 119

Sback = native2unicode(B, 'windows-1252')

Sback = 'How now? brown cow'

[Pete sherer]

This resolves the problem.

My string is either cellstr or string type. Is there a way to bypass using char via a for loop?

City= {'Serra';'Anápolis';'CONCEIÇÃO DE FEIRA';'CONCEIÇÃO DO JACUÃPE'; 'Test ߙߚߛߜߝߞߟߠߡߢߣߤߥ'};

for runi = 1: length(City)

ori = unicode2native( char( City{ runi}), 'windows-1252');

if any(ori==26), disp(['runi=' num2str(runi)]); ori(ori==26)=[]; end;

tnew(runi) = cellstr(native2unicode( ori, 'windows-1252'));

end

Also if I want to check compatibility with UTF-8, do I still check it against 26?