MPAS | graph.info (Mesh Connectivity file)

MPAS

Script for graph.info

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
#!/bin/bash

#------------------------------------------------#
# Author:         wpsze
# Email:          wpsze@gmail.com
# File:           grid2graph.sh
# Date:           2025-07-29 17:05:24
# Version:        0.0 
# Description:    The purpose of the script
# Copyright (C):  2025 All rights reserved
#------------------------------------------------#

#set -e # stop the shell on first error
#set -u # fail when using an undefined variable
#set -x # echo script lines as they are executed
set -o pipefail


source /home/wpsze/micromamba/etc/profile.d/micromamba.sh
micromamba activate venv
export SCRIPT_DIR="$( cd "$( dirname "${BASH_SOURCE[0]}" )" >/dev/null 2>&1 && pwd )"

file=$1
ncells=`ncdump -h $file | grep "nCells = " | cut -d ' ' -f3`
nedges=`ncdump -h $file | grep "nEdges = " | cut -d ' ' -f3`
maxedges=`ncdump -h $file | grep "maxEdges = " | cut -d ' ' -f3`
echo $ncells $nedges
ncdump -v cellsOnCell $file | sed -e "s/[\,,;]//g" | grep -E "^  [0-9][0-9]*" | awk '{ while(++i<=NF) printf (!a[$i]++) ? $i FS : ""; i=split("",a); print ""}'

Take MPAS-120km as example,

1
2
3
4
5
6
7
8
9
10
11
40962 122880
10247 10243 10244 10245 10246 0 
10248 10249 10250 10251 10252 0 
10254 10255 10256 10257 10253 0 
10262 10258 10259 10260 10261 0 
10266 10267 10263 10264 10265 0 
10272 10268 10269 10270 10271 0 
10273 10274 10275 10276 10277 0 
10280 10281 10282 10278 10279 0 
10284 10285 10286 10287 10283 0
......

來自 Perplexity 的回答

Comprehensive Guide to METIS Graph Partitioning and Generating graph.info Files

METIS is a widely-used software suite for partitioning unstructured graphs, meshes, and sparse matrices, enabling efficient parallel computations and reducing computational overhead in large-scale simulations[4]. Among its tools, gpmetis is a command-line program specifically designed for partitioning graphs. A critical component of using gpmetis is the preparation of a properly formatted input file, often referred to as graph.info. This report provides a detailed exploration of the structure and generation of graph.info files, addressing common pitfalls and offering actionable guidance for users.

Understanding the graph.info File

Definition and Purpose

The graph.info file is a plain-text input file that adheres to METIS’s graph format specifications[1][4]. It describes an undirected graph’s structure, including vertices, edges, and optional metadata such as vertex weights or edge weights. This file serves as the primary input for gpmetis, which partitions the graph into a user-specified number of subgraphs while minimizing communication costs or edge cuts[4].

File Structure Requirements

A valid graph.info file must follow these structural rules[4]

  1. Header Line: The first line (excluding comments) specifies:
    • n: Number of vertices.
    • m: Number of edges (counted once per pair, not twice).
    • Optional parameters:
      • fmt: A 3-bit integer encoding the presence of vertex weights, edge weights, or vertex sizes.
      • ncon: Number of vertex weight constraints (for multi-constraint partitioning).
  2. Vertex Lines: Each subsequent line corresponds to a vertex and includes:
    • Weights (if fmt specifies them): One or more integers representing vertex weights.
    • Adjacency List: A space-separated list of adjacent vertices. If edge weights are enabled, each vertex in the adjacency list is followed by its edge weight.

Example of a Valid graph.info File

1
2
3
4
5
4 5 001  
1 2 3  
2 1 4  
3 4  
4 3

This represents a graph with 4 vertices and 5 edges. The fmt value 001 indicates edge weights are present. Vertex 1 is connected to vertices 2 (weight 3) and 3 (weight 4), and so on[4].

Common Formatting Errors

A frequent error arises when the header’s edge count m does not match the actual edges listed in the file. For example, a user reported that specifying 5980 edges in the header resulted in an error because the file contained no edges[2]. This discrepancy often stems from:

  • Incorrectly counting edges (e.g., counting bidirectional edges twice).
  • Misformatted adjacency lists (e.g., using np.int32(512) syntax instead of plain integers)[2].
  • Missing edge weights when fmt requires them.

Generating graph.info Files

Step-by-Step Generation Process

To create a valid graph.info file, follow these steps:

1. Define the Graph Structure

  • Vertices: Determine the total number of vertices (n).
  • Edges: List all undirected edges, ensuring each pair is counted once. For example, an edge between vertices 1 and 2 should appear only once, either in vertex 1’s or vertex 2’s adjacency list[4].

2. Choose Metadata Parameters

  • Vertex Weights: Include these if balancing computational load across partitions.
  • Edge Weights: Add these if optimizing for communication costs between partitions.
  • Multi-Constraint Partitioning: Specify ncon if vertices have multiple weights (e.g., computational and memory constraints)[4].

3. Write the Header Line

Construct the header line using the formula:

1
n m [fmt] [ncon]

For example, a graph with 100 vertices, 200 edges, vertex weights, and edge weights would use fmt=011[4]

1
100 200 011

4. Populate Vertex Lines

For each vertex, list its weights (if applicable) followed by its adjacency list. For edge weights, append the weight after each adjacent vertex:

1
...     ...

5. Validate the File

Use METIS’s graphchk utility to verify the file’s integrity[4]

1
graphchk graph.info

This tool checks for inconsistencies, such as mismatched edge counts or invalid vertex indices.

Automated Generation Methods

For complex graphs, consider these approaches:

  • Mesh-to-Graph Conversion: Use m2gmetis to convert finite element meshes into METIS-compatible graphs[4].
  • Scripting: Write Python or MATLAB scripts to generate adjacency lists from raw data, ensuring proper formatting.
  • Preprocessing Tools: Leverage libraries like NetworkX to export graphs in METIS format.

Troubleshooting Common Issues

Mismatched Edge Counts

If gpmetis reports a discrepancy between the header’s edge count and the actual edges:

  • Recalculate edges, ensuring bidirectional pairs are not double-counted.
  • Use graphchk to identify missing or extraneous edges[4].

Syntax Errors in Vertex Lines

  • Avoid non-integer formats (e.g., np.int32(512))-use plain integers[2].
  • Ensure adjacency lists are space-separated, not comma-separated.

Multi-Constraint Partitioning Failures

If gpmetis ignores vertex weights:

  • Verify fmt’s second bit is set (e.g., 010 for vertex weights).
  • Include ncon in the header if using multiple weight constraints[4].

Advanced Configuration for gpmetis

Command-Line Options

gpmetis supports flags to refine partitioning:

  • -minconn: Minimize maximum connectivity between partitions.
  • -contig: Enforce contiguous partitions.
  • -niter=200: Increase refinement iterations for higher quality[2].

Example usage:

1
gpmetis -minconn -contig -niter=200 graph.info 36

This partitions graph.info into 36 subgraphs with contiguous, low-connectivity partitions[2].

Handling Large Graphs

For graphs exceeding memory limits:

  • Use -ptype=rb (recursive bisection) instead of -ptype=kway (k-way partitioning).
  • Enable disk-based partitioning with -dbglvl=2 to monitor memory usage[4].

Conclusion

The graph.info file is a foundational component of METIS’s graph partitioning workflow, requiring meticulous attention to formatting rules. By adhering to the structured header and vertex line specifications, users can avoid common errors and leverage gpmetis to optimize computational workflows. Future enhancements could involve integrating automated validation directly into preprocessing tools or expanding METIS’s support for heterogeneous graph formats. For researchers and engineers, mastering graph.info generation is essential for harnessing METIS’s full potential in high-performance computing applications.

Citations:

  1. https://people.sc.fsu.edu/~jburkardt/data/metis_graph/metis_graph.html ↩︎
  2. https://forum.mmm.ucar.edu/threads/gpmetis-error.19844/ ↩︎
  3. https://infogram.com ↩︎
  4. https://www.lrz.de/services/software/mathematik/metis/metis_5_0.pdf ↩︎
  5. https://courses.csail.mit.edu/6.895/fall03/projects/papers/kasheff.pdf ↩︎
  6. https://ocw.mit.edu/courses/6-895-theory-of-parallel-systems-sma-5509-fall-2003/6f825562feec8333c6a400a67f1bfebd_kasheff.pdf ↩︎
  7. http://ppl.cs.illinois.edu/doxygen/charm/cmdline__m2gmetis_8c.shtml ↩︎
  8. https://manpages.debian.org/unstable/metis/gpmetis.1 ↩︎
  9. https://github.com/KarypisLab/METIS ↩︎
  10. http://docs.ros.org/en/kinetic/api/gtsam/html/cmdline__gpmetis_8c.html ↩︎
  11. https://mpas-dev.github.io/MPAS-Tools/0.30.0/seaice/partition.html ↩︎
  12. https://www.cfd-online.com/Forums/main/233704-mesh-graph-partitioning-alternative-gpmetis.html ↩︎
  13. https://lihpc-computational-geometry.github.io/metis-rs/metis/struct.Graph.html ↩︎
  14. https://en.wikipedia.org/wiki/METIS ↩︎
  15. https://forum.mmm.ucar.edu/threads/mpas-partitioning-60-15-km-mesh-for-896-cores.5414/ ↩︎
  16. https://github.com/scibuilder/metis/blob/master/programs/gpmetis.c ↩︎
  17. https://stackoverflow.com/questions/31779778/how-to-partition-the-graph-with-edge-weights-using-metis-such-that-the-edgecut-i ↩︎
  18. https://forum.mmm.ucar.edu/threads/where-can-we-find-the-metis-graph-partitioning-software-web-site-not-active.13661/ ↩︎
  19. https://www.cfd-online.com/Forums/main/233704-mesh-graph-partitioning-alternative-gpmetis.html ↩︎
  20. https://forum.mmm.ucar.edu/threads/metis-decomposition.10600/ ↩︎
  21. https://forum.mmm.ucar.edu/threads/gpmetis-error.19844/ ↩︎
  22. https://singularityhub.github.io/shpc-registry/ ↩︎
MPAS
#NWP #WRF #MPAS #mesh generation #Lloyd iteration #graph.info #MPAS-Tools #jigsaw
MPAS | graph.info (Mesh Connectivity file)
https://waipangsze.github.io/2025/05/11/MPAS-graph-info/
Author
wpsze
Posted on
May 11, 2025
Updated on
July 29, 2025
Licensed under