Show Posts

This section allows you to view all posts made by this member. Note that you can only see posts made in areas you currently have access to.


Topics - Lim changmin

Pages: [1] 2
1
General Questions and Answers / Questions about mace trainingset
« on: December 23, 2025, 18:57 »
Hi QuantumATK Support Team,

I’m following the QuantumATK MACE machine-learning tutorial, and I have a few questions about how the TrainingSet(s) used in the tutorial were prepared.

How was the “tutorial TrainingSet” generated?

The tutorial provides a pre-made TrainingSet file. From what I can tell, it looks like crystal random displacements (CRD) may have been used to generate structures.

However, I’m not sure whether the dataset was created via the MTP tutorial-style workflow (e.g., Step 1: “MomentTensorPotential training” / “reference calculator” to label energies/forces/stresses), or if a different workflow was used.

Also, was the TrainingSet created with “Recalculate training data = True” (i.e., structures generated first and then re-labeled with a specified reference calculator), or were the labels produced directly at the time the structures were generated?

Could you clarify the exact workflow and tools used to produce the provided TrainingSet?

How was the amorphous-only TrainingSet produced (and with what DFT settings)?

I noticed another TrainingSet that seems to contain only amorphous structures. Could you share how those amorphous configurations were generated?

Were they obtained from AIMD trajectories (e.g., melt–quench), or were they produced by geometry optimization from some initial amorphous guess (or another sampling method)?

For the DFT labeling step: what k-point sampling was used (Γ-only vs. Monkhorst–Pack, and the specific mesh if applicable)?

If AIMD was used: were the AIMD steps also run at Γ-only and then re-labeled later with a denser k-mesh, or were they labeled with the final k-point settings from the beginning?

Any details you can provide (e.g., whether stresses were included, exact k-point mesh, basis set / pseudopotentials, XC functional, and whether re-labeling was performed) would be very helpful so I can reproduce the tutorial dataset preparation reliably.

Thank you

2
Hi, a few days ago, I posted some questions about MTP error(https://forum.quantumatk.com/index.php?topic=13336.0). From the reply, I tried to study MACE training potential, but didn't work out due to the fact that I didn't have GPU. So I returned to the MTP training, but an error occurred that I have never encountered.

This time the job terminates with many repeated warnings about the Study HDF5 file not existing, and then crashes with an HDF5 “truncated file” error leading to MPI_Abort.
UserWarning: The original file of the Study object 'GeTeCN_amor_train_gga.hdf5' no longer exists.
This means no task results will be saved to the new file.

During MTP training update / dataset construction, the run fails while reading an HDF5 file:

OSError: Unable to open file (truncated file: eof = 338986776, sblock->base_addr = 0, stored_eoa = 338986929)
  File "zipdir/sergio/HDF5/HDF5.py", line 111, in __init__
  File "/home/synopsys/quantumatk/X-2025.06/atkpython/lib/python3.11/site-packages/h5py/_hl/files.py", line 567, in __init__
OSError: Unable to open file (truncated file: eof = 338986776, sblock->base_addr = 0, stored_eoa = 338986929)
OSError: Unable to open file (truncated file: eof = 338986776, sblock->base_addr = 0, stored_eoa = 338986929)
    fid = make_fid(name, mode, userblock_size, fapl, fcpl, swmr=swmr)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/synopsys/quantumatk/X-2025.06/atkpython/lib/python3.11/site-packages/h5py/_hl/files.py", line 231, in make_fid
    fid = h5f.open(name, flags, fapl=fapl)
I attached the rest of the error script below file.

So here's the question
1. What exactly triggers the repeated warning:
“The original file of the Study object … no longer exists”?
Is this typically caused by launching the run from a temporary working directory (e.g., scratch/zipdir) where the original Study HDF5 is not available?
Is there a recommended way to set an absolute/persistent output path for the Study/Workflow files in Active Learning?

2. Regarding the fatal error:
HDF5 truncated file
Is this usually due to interrupted I/O (walltime kill, quota/full filesystem, network filesystem instability), or can concurrent MPI access to the same HDF5 also corrupt/truncate it?
In Active Learning MTP, which specific HDF5 file is being read at this stage (the Study file, a workflow state file, training dataset file, or something else)? Any tips to identify it deterministically?

3. What is the recommended restart/recovery procedure after an HDF5 truncation?
Should I delete/rename the corrupted HDF5 and restart from the last valid iteration?
Is there an official method to validate/repair the HDF5 (or is rollback the only safe option)?

I also attached slurm file and py file that I used

Thank you

3
Hello,
I am trying to use the NonLinearParticleSwarmOptimizationParameters (NLPSOP) for testing purposes. In the TiSi MTP tutorial, it is mentioned that NLPSOP can define the MTP more accurately, so I wanted to try it in my training script. I attached the NLPSOP settings I used as Figure 1.

However, when I run the script, I get the following error:

AttributeError: 'NonLinearParticleSwarmOptimizationParameters' object has no attribute 'initialCoefficients'. Did you mean: 'initialCoefficientsFromFile'?

Could you please let me know how to properly use NLPSOP when training an MTP? In particular, I would like to know:
1. How to correctly specify the NLPSOP block in the training script, and
2. How to set and use initialCoefficientsFromFile (e.g., what kind of file is expected and how to generate it).

Thank you in advance for your help.

4
Hello, I am trying to train MTP with GeTe doped with C and N.
However, I have encountered an error that I have never seen.
This is the error script below.

node01
Tue Nov 18 10:59:59 KST 2025
zipdir/NL/Study/Study.py:788: UserWarning: The original file of the Study object 'GeTeCN_amor_train_2.hdf5' no longer exists.This means no task results will be saved to the new file.
zipdir/NL/Study/Study.py:788: UserWarning: The original file of the Study object 'GeTeCN_amor_train_2.hdf5' no longer exists.This means no task results will be saved to the new file.
zipdir/NL/Study/Study.py:788: UserWarning: The original file of the Study object 'GeTeCN_amor_train_2.hdf5' no longer exists.This means no task results will be saved to the new file.
zipdir/NL/Study/Study.py:788: UserWarning: The original file of the Study object 'GeTeCN_amor_train_2.hdf5' no longer exists.This means no task results will be saved to the new file.
zipdir/NL/Study/Study.py:788: UserWarning: The original file of the Study object 'GeTeCN_amor_train_2.hdf5' no longer exists.This means no task results will be saved to the new file.
zipdir/NL/Study/Study.py:788: UserWarning: The original file of the Study object 'GeTeCN_amor_train_2.hdf5' no longer exists.This means no task results will be saved to the new file.
zipdir/NL/Study/Study.py:788: UserWarning: The original file of the Study object 'GeTeCN_amor_train_2.hdf5' no longer exists.This means no task results will be saved to the new file.
zipdir/NL/Study/Study.py:788: UserWarning: The original file of the Study object 'GeTeCN_amor_train_2.hdf5' no longer exists.This means no task results will be saved to the new file.
zipdir/NL/Study/Study.py:788: UserWarning: The original file of the Study object 'GeTeCN_amor_train_2.hdf5' no longer exists.This means no task results will be saved to the new file.
zipdir/NL/Study/Study.py:788: UserWarning: The original file of the Study object 'GeTeCN_amor_train_2.hdf5' no longer exists.This means no task results will be saved to the new file.
zipdir/NL/Study/Study.py:788: UserWarning: The original file of the Study object 'GeTeCN_amor_train_2.hdf5' no longer exists.This means no task results will be saved to the new file.
zipdir/NL/Study/Study.py:788: UserWarning: The original file of the Study object 'GeTeCN_amor_train_2.hdf5' no longer exists.This means no task results will be saved to the new file.
zipdir/NL/Study/Study.py:788: UserWarning: The original file of the Study object 'GeTeCN_amor_train_2.hdf5' no longer exists.This means no task results will be saved to the new file.
zipdir/NL/Study/Study.py:788: UserWarning: The original file of the Study object 'GeTeCN_amor_train_2.hdf5' no longer exists.This means no task results will be saved to the new file.
zipdir/NL/Study/Study.py:788: UserWarning: The original file of the Study object 'GeTeCN_amor_train_2.hdf5' no longer exists.This means no task results will be saved to the new file.
zipdir/NL/Study/Study.py:788: UserWarning: The original file of the Study object 'GeTeCN_amor_train_2.hdf5' no longer exists.This means no task results will be saved to the new file.
zipdir/NL/Study/Study.py:788: UserWarning: The original file of the Study object 'GeTeCN_amor_train_2.hdf5' no longer exists.This means no task results will be saved to the new file.
zipdir/NL/Study/Study.py:788: UserWarning: The original file of the Study object 'GeTeCN_amor_train_2.hdf5' no longer exists.This means no task results will be saved to the new file.
zipdir/NL/Study/Study.py:788: UserWarning: The original file of the Study object 'GeTeCN_amor_train_2.hdf5' no longer exists.This means no task results will be saved to the new file.
zipdir/NL/Study/Study.py:788: UserWarning: The original file of the Study object 'GeTeCN_amor_train_2.hdf5' no longer exists.This means no task results will be saved to the new file.
zipdir/NL/Study/Study.py:788: UserWarning: The original file of the Study object 'GeTeCN_amor_train_2.hdf5' no longer exists.This means no task results will be saved to the new file.
zipdir/NL/Study/Study.py:788: UserWarning: The original file of the Study object 'GeTeCN_amor_train_2.hdf5' no longer exists.This means no task results will be saved to the new file.
zipdir/NL/Study/Study.py:788: UserWarning: The original file of the Study object 'GeTeCN_amor_train_2.hdf5' no longer exists.This means no task results will be saved to the new file.
zipdir/NL/Study/Study.py:788: UserWarning: The original file of the Study object 'GeTeCN_amor_train_2.hdf5' no longer exists.This means no task results will be saved to the new file.
srun: Job step aborted: Waiting up to 32 seconds for job step to finish.
slurmstepd: error: *** JOB 4041 ON node01 CANCELLED AT 2025-11-18T11:05:56 ***
slurmstepd: error: *** STEP 4041.0 ON node01 CANCELLED AT 2025-11-18T11:05:56 ***

I don't know why the hdf5 no longer exist.
Can anyone help me to solve the error?

Thank you.
I have also attached a py file that I used

5
I understand that machine learning potentials have many advantages and are receiving a lot of attention. However, in the current version of ATK, the provided potentials can only compute force, stress, and energy. Meanwhile, several recent studies have shown the possibility of predicting the density of states (DOS) using machine learning. Therefore, it would be great if ATK could be updated to include ML potentials capable of calculating DOS as well.

6
Hello everyone,

I am seeking guidance on the recommended workflow for developing a Moment Tensor Potential (MTP) for the amorphous Ge-Se-Te ternary system.

A key challenge is the lack of existing DFT or experimental data for the amorphous ternary phase, which makes direct training and validation difficult. To address this, I have formulated a bottom-up strategy which involves creating and validating the constituent binary potentials first:

1. Develop and validate a Ge-Te MTP against published research.

2. Develop and validate a Ge-Se MTP against published research.

3. Develop and validate an Se-Te MTP.

4. Finally, combine these three validated binary MTPs to describe the full ternary system.

My underlying hypothesis is that if a combined potential accurately reproduces the structural properties (e.g., RDF, CN, angular distribution) of the constituent binary systems, it will also provide a reliable description of the ternary system. I have already successfully developed the Ge-Te and Ge-Se potentials, and their results show excellent agreement with previous studies.

With the recent release of QuantumATK X-2025.06, I noticed several improvements to MTP training, including a new 'Load mtp file' block and the ability to save the fit in an MTPParameters object.

This leads to my main questions:

1. Is my proposed methodology—developing and then combining three separate binary MTPs—a scientifically valid and recommended approach for creating a potential for a ternary system like this?

2. Does QuantumATK 2025.06 provide a specific tool or a recommended workflow (perhaps using the new features mentioned above) to combine these separately trained MTPs into a single, functional potential for the Ge-Se-Te system?

Thank you in advance for your support and insights.

7
Hello,

I am currently preparing to perform molecular dynamics simulations on an amorphous Ge-Se-Te structure. As a preliminary step, I plan to generate an initial amorphous configuration using Packmol. However, due to the lack of experimental data for the GeSeTe system, I am unable to determine a reliable reference density.

Is there a recommended approach to theoretically estimate the density of such a structure in the absence of experimental measurements?

Thank you in advance.

8
Hello,

I'm currently trying to calculate the Hartree difference potential (HDP) for a silicide/silicon contact and visualize it alongside the projected local density of states (PLDOS), as shown in the QuantumATK tutorial here:
https://docs.quantumatk.com/tutorials/ag_si_interface/ag_si_interface.html

However, the HDP results I obtained are not what I expected. I assumed that the HDP would show a peak near the interface and then gradually decrease, clearly indicating the Schottky barrier height. But the resulting graph looks quite different from this expectation.

For reference, I used silicon region lengths of 70 Å and 100 Å in separate calculations. I also attached the structure file that I used

Could anyone help me understand why the HDP results might appear unusual or inconsistent with expectations?

Thank you in advance for your help!

9
Hello, I am trying to optimize some amorphous structures, but the log file would not update.
I am not sure what caused this issue.
I am attaching the log file

the log file won't update and so as hdf5 file

It just stopped at this point
+------------------------------------------------------------------------------+
| Diagonalization solver parallelization report                                |
+------------------------------------------------------------------------------+
| Total number of processes: 240                                               |
| Total number of k-points: 14                                                 |
| Processes per k-point: 18                                                    |
+------------------------------------------------------------------------------+
| Process occupation                                                           |
+------------------------------------------------------------------------------+
| Processes   0 -  17: |=====================================================| |
| Processes  18 -  35: |==========================                           | |
| Processes  36 -  53: |==========================                           | |
| Processes  54 -  71: |==========================                           | |
| Processes  72 -  89: |==========================                           | |
| Processes  90 - 107: |==========================                           | |
| Processes 108 - 125: |==========================                           | |
| Processes 126 - 143: |==========================                           | |
| Processes 144 - 161: |==========================                           | |
| Processes 162 - 179: |==========================                           | |
| Processes 180 - 197: |==========================                           | |
| Processes 198 - 215: |==========================                           | |
| Processes 216 - 233: |==========================                           | |
| Processes 234 - 239: |                                                     | |
+------------------------------------------------------------------------------+
| WARNING: Some processes are idle.                                            |
+------------------------------------------------------------------------------+
|   0 E = -840.065 dE =  1.374980e+01 dH =  1.790209e+00                       |

thank you

10
Hello,

I'm currently performing melt-quench molecular dynamics simulations to generate amorphous structures using the Langevin thermostat. In the Langevin method, there's a friction parameter (with a default value of 0.01).

When I use the default value, the system's temperature rapidly rises to unphysically high values like 1e12 K or 1e11 K. However, when I increase the friction coefficient to 0.05 or 0.1, the temperature starts to fluctuate reasonably well around the reservoir temperature.

Still, for some structures, the temperature control is not stable enough. So I'm considering increasing the friction coefficient further to 0.15 or even 0.2.

Here are my questions:

Would increasing the friction coefficient to this extent affect the resulting amorphous structure?

From a theoretical standpoint, how much can I increase the friction coefficient before it starts to significantly affect the dynamics and structural outcomes? Is there a practical or theoretical upper limit?

Kindly waiting for the response.

11
Dear all

Hello, I am trying to make MTP for Carbon-doped Ge(n)Te(m) (n,m are integers).
To start MTP, the tutorial for TiSi MTP indicate to use crystal structure first and then train amorphous.
For amorphous, We can make these structures with packmol, however for crystals, we cannot find structures with C, Te, Ge included.

Therefore I am trying to use crystal structure prediction(i.e. csp). From tutorial, it used forcefield calculator, but I want to use LCAO for more accuracy.
But LCAO requires bulk configuration defined first.
And the script in csp only show elements and the calculator script is prior to elements.
Can someone help me how to revise LCAO for csp?

Thank you

12
Hello, I am trying to calculate GeTe MTP first based on the question in " https://forum.quantumatk.com/index.php?topic=12445.msg42955#new "

At first, the MTP training worked well, but after a few hours the error occurred
License Error: Unable to obtain a required license for the
requested license feature. It could mean there are no valid
licenses left, a problem with the connection to the license
server, or the license file does not contain the requested feature.
See below for more details.

Licensed number of users already reached.
Feature:       qatk_forcefield
License path:  [email protected]:
FlexNet Licensing error:-4,234

And I tried to recalculate it again and the other error occurred.

node01
Thu Feb 20 11:26:21 KST 2025
Traceback (most recent call last):
  File "/home/synopsys/quantumatk/W-2024.09/bin/../atkpython/bin/atkpython", line 8, in <module>
Traceback (most recent call last):
  File "/home/synopsys/quantumatk/W-2024.09/bin/../atkpython/bin/atkpython", line 8, in <module>
    sys.exit(__run_atkpython())
    sys.exit(__run_atkpython())
             ^^^^^^^^^^^^^^^^^
  File "zipdir/ATKExecutables/atkwrappers/__init__.py", line 803, in __run_atkpython
             ^^^^^^^^^^^^^^^^^
  File "zipdir/ATKExecutables/atkwrappers/__init__.py", line 803, in __run_atkpython
  File "gete_mtp.py", line 338, in <module>
  File "gete_mtp.py", line 338, in <module>
    training__set__table.addInstanceColumn(key='training_set', types=TrainingSet)
  File "zipdir/NL/ComputerScienceUtilities/Table/Columns.py", line 2269, in addInstanceColumn
    training__set__table.addInstanceColumn(key='training_set', types=TrainingSet)
  File "zipdir/NL/ComputerScienceUtilities/Table/Columns.py", line 2269, in addInstanceColumn
  File "zipdir/NL/ComputerScienceUtilities/Table/Columns.py", line 2301, in addColumn
NL.ComputerScienceUtilities.Exceptions.NLValueError: The column key, training_set, is already used in the table. Duplicate keys are not allowed.
  File "zipdir/NL/ComputerScienceUtilities/Table/Columns.py", line 2301, in addColumn
NL.ComputerScienceUtilities.Exceptions.NLValueError: The column key, training_set, is already used in the table. Duplicate keys are not allowed.
Traceback (most recent call last):
  File "/home/synopsys/quantumatk/W-2024.09/bin/../atkpython/bin/atkpython", line 8, in <module>
Abort(1) on node 3 (rank 3 in comm 0): application called MPI_Abort(MPI_COMM_WORLD, 1) - process 3
Abort(1) on node 12 (rank 12 in comm 0): application called MPI_Abort(MPI_COMM_WORLD, 1) - process 12
    sys.exit(__run_atkpython())
             ^^^^^^^^^^^^^^^^^
  File "zipdir/ATKExecutables/atkwrappers/__init__.py", line 803, in __run_atkpython

I tried to find some answers to this "Duplicate keys are not allowed" error from atk forum but I couldn't find any.

Can anyone help me with this issue?

I attached the py file that I used bellow.

Thank you

13
Hello, I am trying to calculate transmission spectrum at 0 eV with Silicon/Silicide contact with different doping concentration(5e19,1e20,5e20,1e21)

I tried to converge the LCAO calculator but the device would not converge.

I changed density mesh cutoff, device algorithm(neutral atom, equivalent bulk etc..), contour parameter(ozaki point) for about a week with same structure, but nothing would work.

I tried to solve this problem on my own, but after spending a week with same structure, I realized it was beyond my beyond my capabilities.
Therefore, I have decided to seek assistance.

I am wondering if I am making a mistake or the structure is not properly optimized(0.02eV/A, optimize length : 10A). (I attached txt file of the calculation information)

Can anyone could give me some tips regarding with convergence problem?

When I check the log file, for some reason, the convergence energy suddenly changed to higher value. (40E~42E)

26 E = -940.453 dE =  3.211179e-01 dH =  8.870016e-01                       |
|  27 E = -942.197 dE =  1.744240e+00 dH =  8.995829e-01                       |
|  28 E =  -941.24 dE =  9.571292e-01 dH =  7.565638e-01                       |
|  29 E = -942.876 dE =  1.635776e+00 dH =  8.258672e-01                       |
|  30 E = -943.925 dE =  1.048822e+00 dH =  8.581108e-01                       |
|  31 E =  -944.33 dE =  4.050945e-01 dH =  9.593208e-01                       |
|  32 E = -942.058 dE =  2.272090e+00 dH =  8.716657e-01                       |
|  33 E = -942.011 dE =  4.704906e-02 dH =  8.909611e-01                       |
|  34 E = -941.766 dE =  2.451188e-01 dH =  7.616103e-01                       |
|  35 E = -942.428 dE =  6.625315e-01 dH =  7.147292e-01                       |
|  36 E = -942.211 dE =  2.172081e-01 dH =  6.725936e-01                       |
|  37 E = -942.583 dE =  3.722324e-01 dH =  6.988655e-01                       |
|  38 E = -942.315 dE =  2.688179e-01 dH =  7.281209e-01                       |
|  39 E = -946.068 dE =  3.753141e+00 dH =  7.930580e-01                       |
|  40 E = -944.435 dE =  1.633055e+00 dH =  6.637546e-01                       |
|  41 E =  -961.58 dE =  1.714573e+01 dH =  2.050847e+00                       |
|  42 E = -2420.58 dE =  1.458995e+03 dH =  8.792229e+01                       |
|  43 E = -2558.35 dE =  1.377787e+02 dH =  9.421465e+01                       |
|  44 E = -2414.11 dE =  1.442476e+02 dH =  8.872245e+01                       |
|  45 E = -1620.06 dE =  7.940496e+02 dH =  5.332355e+01                       |
|  46 E = -1685.53 dE =  6.547581e+01 dH =  5.754290e+01                       |
|  47 E = -2391.43 dE =  7.058958e+02 dH =  9.732136e+01                       |
|  48 E = -2297.45 dE =  9.397452e+01 dH =  9.073635e+01                       |
 

Thank you for reading the question

14
Hello, I have some questions regarding MTP training with dopant atom attached.

We are planning to put carbon dopant in GeTe amorphous structure with different doping density.

However, since there are no force field related to C, Ge, Te, we decided to create MTP.

Here is the question, to create MTP, as far as I know, making initial training set is essential.

But since there are no initial training set regarding to different carbon doping density in GeTe, I wonder how should we proceed with the first step of creating MTP.

Is there any tips for it?

15
Hello, I am trying to match some surface with interface builder.

There are a lot of surface cell that I could choose, however for some samples, the sentence "Some matches are degenerate" turns into red and show the degenerate match groups.

Could anyone please tell me what this means? and could it affect the calculation results?

Also how can I solve this degenerate issue?


Pages: [1] 2