Home

Awesome

NAME

Lingua::LO::NLP - Various Lao text processing functions

SYNOPSIS

use utf8;
use 5.10.1;
use open qw/ :std :encoding(UTF-8) /;
use Lingua::LO::NLP;
use Data::Dumper;

my $lao = Lingua::LO::NLP->new;

my @syllables = $lao->split_to_syllables("ສະບາຍດີ"); # qw( ສະ ບາຍ ດີ )
print Dumper(\@syllables);

for my $syl (@syllables) {
    my $analysis = $lao->analyze_syllable($syl);
    printf "%s: %s\n", $analysis->syllable, $analysis->tone;
    # ສະ: TONE_HIGH_STOP
    # ບາຍ: TONE_LOW
    # ດີ: TONE_LOW
}

say $lao->romanize("ສະບາຍດີ", variant => 'PCGN', hyphen => "\N{HYPHEN}");  # sa‐bay‐di
say $lao->romanize("ສະບາຍດີ", variant => 'IPA');                           # sa baːj diː

DESCRIPTION

This module provides various functions for processing Lao text. Currently it can

These functions are basically just shortcuts to the functionality of some specialized modules: Lingua::LO::NLP::Syllabify, Lingua::LO::NLP::Analyze and Lingua::LO::NLP::Romanize. If you need only one of them, you can shave off a little overhead by using those directly.

METHODS

new

new(option =E<gt> value, ...)

The object constructor currently does nothing; there are no options. However, it is likely that there will be in future versions, therefore it is highly recommended to call methods as object methods so your code won't break when I introduce them.

split_to_syllables

my @syllables = $object-E<gt>split_to_syllables($text, %options );

Split Lao text into its syllables using a regexp modelled after PHISSAMAY, DALALOY and DURRANI: Syllabification of Lao Script for Line Breaking. Takes as its only mandatory parameter a character string to split and optionally a number of named options; see "new" in Lingua::LO::NLP::Syllabify for those. Returns a list of syllables.

analyze_syllable

my $classified = $object-E<gt>analyze_syllable($syllable, %options);

Returns a Lingua::LO::NLP::Analyze object that allows you to query various syllable properties such as core consonant, tone mark, vowel length and tone. See there for details.

romanize

$object-E<gt>romanize($lao, %options);

Returns a romanized version of the text passed in as $lao. See "new" in Lingua::LO::NLP::Romanize for options. If you don't pass in any options, the default is variant => 'PCGN'.

SEE ALSO

Lingua::LO::Romanize is the module that inspired this one. It has some issues with ambiguous syllable boundaries as in "ໃນວົງ" though.

AUTHOR

Matthias Bethke, matthias@towiski.de

COPYRIGHT AND LICENSE

Copyright (C) 2016 by Matthias Bethke

This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself, either Perl version 5.14.2 or, at your option, any later version of Perl 5 you may have available. Significant portions of the code are (C) PostgreSQL Global Development Group and The Regents of the University of California. All modified versions must retain the file COPYRIGHT included in the distribution.