Code to do Alphabet[] more properly

Perhaps we will expand this for other things...

Author: rocky

.editorconfig

@@ -0,0 +1,17 @@
+root = true
+
+[*]
+end_of_line = lf
+insert_final_newline = true
+charset = utf-8
+indent_style = tab
+indent_size = 4
+
+[*.yml]
+indent_style = space
+indent_size = 2
+
+[*.py]
+indent_style = space
+indent_size = 4
+trim_trailing_whitespace: true

.gitignore

@@ -0,0 +1,9 @@
+*~
+.python-version
+/ChangeLog
+/build
+/dist
+/pymathics_language.egg-info
+/pymathics_natlang.egg-info
+/tmp
+__pycache__

.pre-commit-config.yaml

@@ -0,0 +1,23 @@
+default_language_version:
+ python: python
+repos:
+- repo: https://github.com/pre-commit/pre-commit-hooks
+ rev: v4.0.1
+ hooks:
+ - id: check-merge-conflict
+ - id: debug-statements
+ stages: [commit]
+ - id: end-of-file-fixer
+ stages: [commit]
+ - id: trailing-whitespace
+- repo: https://github.com/psf/black
+ rev: 22.3.0
+ hooks:
+ - id: black
+ language_version: python3
+ exclude: 'mathicsscript/version.py'
+- repo: https://github.com/pycqa/flake8
+ rev: 3.9.2
+ hooks:
+ - id: flake8
+ stages: [commit]

CODE_OF_CONDUCT.md

@@ -0,0 +1,128 @@
+# Contributor Covenant Code of Conduct
+
+## Our Pledge
+
+We as members, contributors, and leaders pledge to make participation in our
+community a harassment-free experience for everyone, regardless of age, body
+size, visible or invisible disability, ethnicity, sex characteristics, gender
+identity and expression, level of experience, education, socio-economic status,
+nationality, personal appearance, race, religion, or sexual identity
+and orientation.
+
+We pledge to act and interact in ways that contribute to an open, welcoming,
+diverse, inclusive, and healthy community.
+
+## Our Standards
+
+Examples of behavior that contributes to a positive environment for our
+community include:
+
+* Demonstrating empathy and kindness toward other people
+* Being respectful of differing opinions, viewpoints, and experiences
+* Giving and gracefully accepting constructive feedback
+* Accepting responsibility and apologizing to those affected by our mistakes,
+ and learning from the experience
+* Focusing on what is best not just for us as individuals, but for the
+ overall community
+
+Examples of unacceptable behavior include:
+
+* The use of sexualized language or imagery, and sexual attention or
+ advances of any kind
+* Trolling, insulting or derogatory comments, and personal or political attacks
+* Public or private harassment
+* Publishing others' private information, such as a physical or email
+ address, without their explicit permission
+* Other conduct which could reasonably be considered inappropriate in a
+ professional setting
+
+## Enforcement Responsibilities
+
+Community leaders are responsible for clarifying and enforcing our standards of
+acceptable behavior and will take appropriate and fair corrective action in
+response to any behavior that they deem inappropriate, threatening, offensive,
+or harmful.
+
+Community leaders have the right and responsibility to remove, edit, or reject
+comments, commits, code, wiki edits, issues, and other contributions that are
+not aligned to this Code of Conduct, and will communicate reasons for moderation
+decisions when appropriate.
+
+## Scope
+
+This Code of Conduct applies within all community spaces, and also applies when
+an individual is officially representing the community in public spaces.
+Examples of representing our community include using an official e-mail address,
+posting via an official social media account, or acting as an appointed
+representative at an online or offline event.
+
+## Enforcement
+
+Instances of abusive, harassing, or otherwise unacceptable behavior may be
+reported to the community leaders responsible for enforcement at
+.
+All complaints will be reviewed and investigated promptly and fairly.
+
+All community leaders are obligated to respect the privacy and security of the
+reporter of any incident.
+
+## Enforcement Guidelines
+
+Community leaders will follow these Community Impact Guidelines in determining
+the consequences for any action they deem in violation of this Code of Conduct:
+
+### 1. Correction
+
+**Community Impact**: Use of inappropriate language or other behavior deemed
+unprofessional or unwelcome in the community.
+
+**Consequence**: A private, written warning from community leaders, providing
+clarity around the nature of the violation and an explanation of why the
+behavior was inappropriate. A public apology may be requested.
+
+### 2. Warning
+
+**Community Impact**: A violation through a single incident or series
+of actions.
+
+**Consequence**: A warning with consequences for continued behavior. No
+interaction with the people involved, including unsolicited interaction with
+those enforcing the Code of Conduct, for a specified period of time. This
+includes avoiding interactions in community spaces as well as external channels
+like social media. Violating these terms may lead to a temporary or
+permanent ban.
+
+### 3. Temporary Ban
+
+**Community Impact**: A serious violation of community standards, including
+sustained inappropriate behavior.
+
+**Consequence**: A temporary ban from any sort of interaction or public
+communication with the community for a specified period of time. No public or
+private interaction with the people involved, including unsolicited interaction
+with those enforcing the Code of Conduct, is allowed during this period.
+Violating these terms may lead to a permanent ban.
+
+### 4. Permanent Ban
+
+**Community Impact**: Demonstrating a pattern of violation of community
+standards, including sustained inappropriate behavior, harassment of an
+individual, or aggression toward or disparagement of classes of individuals.
+
+**Consequence**: A permanent ban from any sort of public interaction within
+the community.
+
+## Attribution
+
+This Code of Conduct is adapted from the [Contributor Covenant][homepage],
+version 2.0, available at
+https://www.contributor-covenant.org/version/2/0/code_of_conduct.html.
+
+Community Impact Guidelines were inspired by [Mozilla's code of conduct
+enforcement ladder](https://github.com/mozilla/diversity).
+
+[homepage]: https://www.contributor-covenant.org
+
+For answers to common questions about this code of conduct, see the FAQ at
+https://www.contributor-covenant.org/faq. Translations are available at
+https://www.contributor-covenant.org/translations.

README.rst

@@ -0,0 +1,12 @@
+Mathics Language and Translation Toolkit module.
+
+Example Session
+---------------
+
+::
+
+ $ mathicsscript
+ In[1]:= LoadModule["pymathics.language"]
+ Out[1]= pymathics.language
+ In[2]= Alphabet["Croatian"]
+ Out[2]= {['a', 'b', 'c', 'd', 'e', 'f', 'g', 'h', 'i', 'j', 'k', 'l', 'm', 'n', 'o', 'p', 'r', 's', 't', 'u', 'v', 'z', 'ć', 'č', 'đ', 'š', 'ž', 'dž', 'lj', 'nj']}

pymathics/language/__init__.py

@@ -0,0 +1,18 @@
+"""Pymathics Language
+
+This module provides Mathics functions and varialbles to work with
+Lanugages and Translations
+"""
+
+
+from pymathics.language.__main__ import Alphabet
+from pymathics.language.version import __version__
+
+pymathics_version_data = {
+ "author": "The Mathics Team",
+ "version": __version__,
+ "name": "Language",
+ "requires": ["PyICU"],
+}
+
+__all__ = ["Alphabet", "pymathics_version_data", "__version__"]

pymathics/language/__main__.py

@@ -0,0 +1,73 @@
+# -*- coding: utf-8 -*-
+
+"""
+Languages & Translations
+"""
+
+# PYTHON MODULES USED IN HERE
+
+# PyICU: human-language alphabets and locales
+
+
+from icu import Locale, LocaleData
+from typing import List, Optional
+
+from mathics.builtin.base import Builtin
+from mathics.core.atoms import String
+from mathics.core.convert.expression import to_mathics_list
+
+availableLocales = Locale.getAvailableLocales()
+language2locale = {
+ availableLocale.getDisplayLanguage(): locale_name
+ for locale_name, availableLocale in availableLocales.items()
+}
+
+
+def eval_alphabet(language_name: String) -> Optional[List[String]]:
+
+ py_language_name = language_name.value
+ locale = language2locale.get(py_language_name, py_language_name)
+ if locale not in availableLocales:
+ return
+ alphabet_set = LocaleData(locale).getExemplarSet(0, 0)
+ return to_mathics_list(list(alphabet_set), elements_conversion_fn=String)
+
+
+class Alphabet(Builtin):
+ """
+ Basic lowercase alphabet via <url>:Unicode: https://home.unicode.org/</url> and <url>:PyICU: https://pypi.org/project/PyICU/</url>
+ <dl>
+ <dt>'Alphabet'[]
+ <dd>gives the list of lowercase letters a-z in the English alphabet .
+
+ <dt>'Alphabet[$type$]'
+ <dd> gives the alphabet for the language or class $type$.
+ </dl>
+
+ >> Alphabet[]
+ = {a, b, c, d, e, f, g, h, i, j, k, l, m, n, o, p, q, r, s, t, u, v, w, x, y, z}
+ >> Alphabet["Ukrainian"]
+ = {a, ä, b, c, d, e, f, g, h, i, j, k, l, m, n, o, ö, p, q, r, s, ß, t, u, ü, v, w, x, y, z}
+
+ Some languages have the same basic set of letters.
+ >> Alphabet["en_NZ"] == Alphabet["en"]
+ = True
+ """
+
+ messages = {
+ "nalph": "The alphabet `` is not known or not available.",
+ }
+
+ rules = {
+ "Alphabet[]": """Alphabet["English"]""",
+ }
+
+ summary_text = "lowercase letters in an alphabet"
+
+ def apply(self, alpha: String, evaluation):
+ """Alphabet[alpha_String]"""
+ alphabet_list = eval_alphabet(alpha)
+ if alphabet_list is None:
+ evaluation.message("Alphabet", "nalph", alpha)
+ return
+ return alphabet_list

pymathics/language/version.py

@@ -0,0 +1,8 @@
+# -*- coding: utf-8 -*-
+
+
+# This file is suitable for sourcing inside POSIX shell as
+# well as importing into Python. That's why there is no
+# space around "=" below.
+# fmt: off
+__version__="5.0.0" # noqa

setup.cfg

@@ -0,0 +1,43 @@
+[bdist_wheel]
+universal = False
+
+[metadata]
+description_file = README.rst
+
+# Recommended flake8 settings while editing zoom, we use Black for the final
+# linting/say in how code is formatted
+#
+# pip install flake8 flake8-bugbear
+#
+# This will warn/error on things that black does not fix, on purpose.
+
+# This config file MUST be ASCII to prevent weird flake8 dropouts
+
+[flake8]
+# max-line-length setting: NO we do not want everyone writing 120-character lines!
+# We are setting the maximum line length big here because there are longer
+# lines allowed by black in some cases that are forbidden by flake8. Since
+# black has the final say about code formatting issues, this setting is here to
+# make sure that flake8 doesn't fail the build on longer lines allowed by
+# black.
+max-line-length = 120
+max-complexity = 12
+select = E,F,W,C,B,B9
+ignore =
+ # E123 closing bracket does not match indentation of opening bracket's line
+ E123
+ # E203 whitespace before ':' (Not PEP8 compliant, Python Black)
+ E203
+ # E501 line too long (82 > 79 characters) (replaced by B950 from flake8-bugbear,
+ # https://github.com/PyCQA/flake8-bugbear)
+ E501
+ # W503 line break before binary operator (Not PEP8 compliant, Python Black)
+ W503
+ # W504 line break after binary operator (Not PEP8 compliant, Python Black)
+ W504
+ # C901 function too complex - since many of zz9 functions are too complex with a lot
+ # of if branching
+ C901
+ # module level import not at top of file. This is too restrictive. Can't even have a
+ # docstring higher.
+ E402