You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-08 - 01:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack9slot3s.osadl.org (updated Sun Jun 07, 2026 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591610,44ptp4l0-21swapper/007:06:020
119591610,31ptp4l0-21swapper/107:09:591
1583325248,2sleep30-21swapper/307:06:033
1514425045,2sleep20-21swapper/207:05:212
119591210,0ptp4l0-21swapper/112:38:341
119591180,0ptp4l0-21swapper/112:00:021
119591170,0ptp4l0-21swapper/111:05:161
119591160,1ptp4l24988-21apt-get08:25:120
119591160,1ptp4l17416-21snmp_o5powerctl12:10:231
119591160,1ptp4l13248-21apt-get11:05:140
119591160,1ptp4l11804-21ls11:00:171
119591160,0ptp4l0-21swapper/110:50:241
119591160,0ptp4l0-21swapper/108:10:131
119591160,0ptp4l0-21swapper/012:30:130
119591160,0ptp4l0-21swapper/010:00:120
119591160,0ptp4l0-21swapper/009:35:130
119591150,2ptp4l0-21swapper/107:14:291
119591150,1ptp4l8934-21df08:55:141
119591150,1ptp4l8668-21irqstats11:55:180
119591150,1ptp4l577-21tr10:40:170
119591150,1ptp4l4260-21snmp_o5powerctl09:45:231
119591150,1ptp4l400-21apt-get07:40:020
119591150,1ptp4l32120-21snmp_o5powerctl07:35:221
119591150,1ptp4l31444-21ls09:35:242
119591150,1ptp4l31364-21snmp_o5powerctl09:35:221
119591150,1ptp4l30280-21apt-get08:35:120
119591150,1ptp4l29312-21apt-get10:35:130
119591150,1ptp4l27806-21hddtemp_smartct12:30:161
119591150,1ptp4l27472-21expr09:30:130
119591150,1ptp4l26215-21ls09:25:221
119591150,1ptp4l25692-21snmp_o5powerctl10:25:220
119591150,1ptp4l25527-21snmp_o5powerctl11:25:211
119591150,1ptp4l23699-21apt-get12:25:121
119591150,1ptp4l23015-21grep12:20:230
119591150,1ptp4l22437-21hddtemp_smartct09:20:141
119591150,1ptp4l21344-21smartctl08:15:241
119591150,1ptp4l20374-21snmp_o5powerctl10:15:221
119591150,1ptp4l16588-21hddtemp_smartct11:10:171
119591150,1ptp4l15159-21/usr/sbin/munin10:05:230
119591150,1ptp4l13118-21ntp_states08:00:200
119591150,1ptp4l13082-21apt12:05:121
119591150,0ptp4l23860-21apt-get11:25:120
119591150,0ptp4l0-21swapper/210:50:022
119591150,0ptp4l0-21swapper/111:55:131
119591150,0ptp4l0-21swapper/110:55:021
119591150,0ptp4l0-21swapper/109:05:231
119591150,0ptp4l0-21swapper/107:55:231
119591150,0ptp4l0-21swapper/107:40:131
119591150,0ptp4l0-21swapper/011:00:120
119591150,0ptp4l0-21swapper/009:25:110
119591150,0ptp4l0-21swapper/009:20:110
119591150,0ptp4l0-21swapper/008:55:220
16403991413,1cyclictest27363-21lspci12:30:142
119591140,1ptp4l9694-21grep07:55:160
119591140,1ptp4l6717-21cstates07:50:130
119591140,1ptp4l33-21ksoftirqd/207:10:142
119591140,1ptp4l29240-21systemctl08:30:200
119591140,1ptp4l2187-21/usr/sbin/munin10:45:230
119591140,1ptp4l20460-21ntpq09:15:200
119591140,1ptp4l19655-21/usr/sbin/munin11:15:181
119591140,1ptp4l19603-21memory12:15:181
119591140,1ptp4l19438-21munin-run08:15:010
119591140,1ptp4l17818-21ntp_states09:10:191
119591140,1ptp4l12215-21sed12:00:230
119591140,0ptp4l7500-21snmp_o5powerctl08:50:230
119591140,0ptp4l6121-21ls11:50:180
119591140,0ptp4l23876-21awk12:25:130
119591140,0ptp4l14844-21df08:05:151
119591140,0ptp4l0-21swapper/212:10:162
119591140,0ptp4l0-21swapper/211:05:232
119591140,0ptp4l0-21swapper/208:40:182
119591140,0ptp4l0-21swapper/112:23:421
119591140,0ptp4l0-21swapper/111:50:221
119591140,0ptp4l0-21swapper/111:45:211
119591140,0ptp4l0-21swapper/111:40:131
119591140,0ptp4l0-21swapper/111:30:191
119591140,0ptp4l0-21swapper/111:20:161
119591140,0ptp4l0-21swapper/110:45:171
119591140,0ptp4l0-21swapper/110:35:201
119591140,0ptp4l0-21swapper/110:30:201
119591140,0ptp4l0-21swapper/110:25:191
119591140,0ptp4l0-21swapper/110:20:171
119591140,0ptp4l0-21swapper/110:14:091
119591140,0ptp4l0-21swapper/110:05:221
119591140,0ptp4l0-21swapper/109:55:021
119591140,0ptp4l0-21swapper/109:40:121
119591140,0ptp4l0-21swapper/109:15:231
119591140,0ptp4l0-21swapper/109:00:221
119591140,0ptp4l0-21swapper/108:49:311
119591140,0ptp4l0-21swapper/108:40:171
119591140,0ptp4l0-21swapper/108:35:121
119591140,0ptp4l0-21swapper/108:30:141
119591140,0ptp4l0-21swapper/108:25:021
119591140,0ptp4l0-21swapper/108:20:181
119591140,0ptp4l0-21swapper/108:00:221
119591140,0ptp4l0-21swapper/107:50:191
119591140,0ptp4l0-21swapper/107:45:211
119591140,0ptp4l0-21swapper/107:30:181
119591140,0ptp4l0-21swapper/107:26:201
119591140,0ptp4l0-21swapper/107:20:141
119591140,0ptp4l0-21swapper/107:15:241
119591140,0ptp4l0-21swapper/012:35:220
119591140,0ptp4l0-21swapper/012:15:230
119591140,0ptp4l0-21swapper/012:05:230
119591140,0ptp4l0-21swapper/011:45:130
119591140,0ptp4l0-21swapper/011:40:210
119591140,0ptp4l0-21swapper/011:30:020
119591140,0ptp4l0-21swapper/011:10:160
119591140,0ptp4l0-21swapper/010:55:230
119591140,0ptp4l0-21swapper/010:30:140
119591140,0ptp4l0-21swapper/010:20:200
119591140,0ptp4l0-21swapper/010:15:220
119591140,0ptp4l0-21swapper/010:10:210
119591140,0ptp4l0-21swapper/009:55:140
119591140,0ptp4l0-21swapper/009:45:180
119591140,0ptp4l0-21swapper/009:10:240
119591140,0ptp4l0-21swapper/009:05:180
119591140,0ptp4l0-21swapper/008:40:230
119591140,0ptp4l0-21swapper/008:20:230
119591140,0ptp4l0-21swapper/008:15:160
119591140,0ptp4l0-21swapper/008:05:240
119591140,0ptp4l0-21swapper/007:10:230
119591130,0ptp4l0-21swapper/212:25:202
119591130,0ptp4l0-21swapper/212:00:222
119591130,0ptp4l0-21swapper/211:25:232
119591130,0ptp4l0-21swapper/211:20:022
119591130,0ptp4l0-21swapper/211:15:132
119591130,0ptp4l0-21swapper/210:15:132
119591130,0ptp4l0-21swapper/210:05:132
119591130,0ptp4l0-21swapper/208:30:142
119591130,0ptp4l0-21swapper/208:15:222
119591130,0ptp4l0-21swapper/207:50:152
119591130,0ptp4l0-21swapper/207:45:202
119591130,0ptp4l0-21swapper/111:35:131
119591130,0ptp4l0-21swapper/110:40:141
119591130,0ptp4l0-21swapper/110:00:141
119591130,0ptp4l0-21swapper/109:50:141
119591130,0ptp4l0-21swapper/109:30:141
119591130,0ptp4l0-21swapper/108:50:151
119591130,0ptp4l0-21swapper/012:10:130
119591130,0ptp4l0-21swapper/011:35:180
119591130,0ptp4l0-21swapper/011:20:150
119591130,0ptp4l0-21swapper/011:15:140
119591130,0ptp4l0-21swapper/010:50:130
119591130,0ptp4l0-21swapper/009:50:020
119591130,0ptp4l0-21swapper/009:40:140
119591130,0ptp4l0-21swapper/009:00:020
119591130,0ptp4l0-21swapper/008:45:140
119591130,0ptp4l0-21swapper/007:45:140
119591130,0ptp4l0-21swapper/007:35:150
119591130,0ptp4l0-21swapper/007:30:130
119591130,0ptp4l0-21swapper/007:25:130
119591130,0ptp4l0-21swapper/007:20:160
119591130,0ptp4l0-21swapper/007:15:020
16404991210,1cyclictest27363-21lspci12:30:143
1640399120,2cyclictest0-21swapper/209:45:132
119591120,0ptp4l0-21swapper/211:10:152
119591120,0ptp4l0-21swapper/210:45:202
119591120,0ptp4l0-21swapper/209:25:202
1640499110,8cyclictest0-21swapper/310:05:123
1640499110,5cyclictest0-21swapper/310:55:023
119591110,2ptp4l0-21swapper/210:33:362
119591110,0ptp4l0-21swapper/211:40:162
119591110,0ptp4l0-21swapper/210:29:562
164049997,1cyclictest47002sleep309:46:273
164049997,1cyclictest31920-21taskset09:37:583
164049997,1cyclictest26336-21chrt10:29:073
164049997,1cyclictest24903-21cron07:25:003
164049997,1cyclictest2240-21/usr/sbin/munin11:45:193
164049997,1cyclictest21076-21chrt10:19:463
164049997,1cyclictest16732sleep311:40:373
164049997,1cyclictest15071-21grep12:05:253
164049997,1cyclictest14731-21tr09:05:173
164039997,1cyclictest19837-21cut12:15:212
164039997,1cyclictest17265-21tr08:10:142
164039997,1cyclictest10807-21basename10:00:122
164039996,2cyclictest21279-21phc2sys-jitter07:15:212
164039990,8cyclictest22806-21tail10:20:202
11959190,0ptp4l0-21swapper/311:14:183
11959190,0ptp4l0-21swapper/212:37:542
11959190,0ptp4l0-21swapper/212:20:062
11959190,0ptp4l0-21swapper/212:06:422
11959190,0ptp4l0-21swapper/211:51:322
11959190,0ptp4l0-21swapper/211:47:362
11959190,0ptp4l0-21swapper/211:36:382
11959190,0ptp4l0-21swapper/211:30:282
11959190,0ptp4l0-21swapper/210:55:382
11959190,0ptp4l0-21swapper/210:40:482
11959190,0ptp4l0-21swapper/210:35:292
11959190,0ptp4l0-21swapper/210:10:042
11959190,0ptp4l0-21swapper/209:56:432
11959190,0ptp4l0-21swapper/209:40:502
11959190,0ptp4l0-21swapper/209:30:172
11959190,0ptp4l0-21swapper/209:22:362
11959190,0ptp4l0-21swapper/209:17:012
11959190,0ptp4l0-21swapper/209:10:122
11959190,0ptp4l0-21swapper/209:02:412
11959190,0ptp4l0-21swapper/208:55:042
11959190,0ptp4l0-21swapper/208:45:252
11959190,0ptp4l0-21swapper/208:37:322
11959190,0ptp4l0-21swapper/208:27:502
11959190,0ptp4l0-21swapper/208:20:422
11959190,0ptp4l0-21swapper/208:06:392
11959190,0ptp4l0-21swapper/208:01:542
11959190,0ptp4l0-21swapper/207:56:202
11959190,0ptp4l0-21swapper/207:40:592
11959190,0ptp4l0-21swapper/207:36:482
11959190,0ptp4l0-21swapper/207:33:382
11959190,0ptp4l0-21swapper/207:27:232
164049986,1cyclictest8778-21expr08:55:133
164049986,1cyclictest8606-21taskset07:52:243
164049986,1cyclictest8352-21grep09:55:133
164049986,1cyclictest5517-21expr09:50:133
164049986,1cyclictest521-21chrt12:37:543
164049986,1cyclictest5101-21head10:50:133
164049986,1cyclictest3786-21tr07:45:143
164049986,1cyclictest3644-21expr08:45:143
164049986,1cyclictest3278-21chrt07:44:373
164049986,1cyclictest31507-21cut07:35:163
164049986,1cyclictest30743-21chrt08:35:133
164049986,1cyclictest30399-21cut10:35:183
164049986,1cyclictest30094-21if_enp0s31f611:35:163
164049986,1cyclictest28842-21load08:30:163
164049986,1cyclictest28267-21expr07:30:133
164049986,1cyclictest27645-21head09:30:143
164049986,1cyclictest26990-21expr11:30:133
164049986,1cyclictest26917-21grep07:25:223
164049986,1cyclictest26439-21taskset09:25:333
164049986,1cyclictest26371-21ntpq08:25:183
164049986,1cyclictest24564-21if_err_enp4s012:25:163
164049986,1cyclictest23834-21cat11:25:113
164049986,1cyclictest2336-21cat08:40:223
164049986,1cyclictest23306-21taskset11:21:103
164049986,1cyclictest22509-21taskset12:20:193
164049986,1cyclictest219372sleep308:18:203
164049986,1cyclictest21719-21chrt09:20:093
164049986,1cyclictest21626-21cut10:20:143
164049986,1cyclictest20689-21chrt11:16:513
164049986,1cyclictest19777-21hwlatdetect09:15:163
164049986,1cyclictest19214-21needreboot07:15:013
164049986,1cyclictest19185-21taskset08:11:583
164049986,1cyclictest18638-21cut12:15:143
164049986,1cyclictest1847-21grep09:40:233
164049986,1cyclictest18132-21taskset10:10:553
164049986,1cyclictest18046-21sendmail_mailst07:10:213
164049986,1cyclictest16646-21tr09:10:133
164049986,1cyclictest14683-21cat08:05:133
164049986,1cyclictest13587-21ls11:05:153
164049986,1cyclictest13176-21phc2sys-jitter08:00:203
164049986,1cyclictest11364-21tr09:00:133
164049986,1cyclictest10964-21tr10:00:133
164049986,1cyclictest10907-21expr11:00:133
164049986,1cyclictest10906-21sed07:55:243
164049986,1cyclictest10867-21expr12:00:143
164049981,5cyclictest0-21swapper/308:20:133
164049981,4cyclictest0-21swapper/310:40:123
164049980,7cyclictest8520-21sed11:55:183
164049980,7cyclictest28028-21ntpq10:30:173
164039986,1cyclictest7893-21expr11:55:142
164039986,1cyclictest5846-21cut08:50:132
164039986,1cyclictest5199-21taskset09:50:082
164039986,1cyclictest22638-21grep07:20:132
164039986,1cyclictest14746-21cut09:05:172
164039982,4cyclictest10597-21apt-get11:00:122
11959180,0ptp4l0-21swapper/311:53:223
164049975,1cyclictest16774-21tr12:10:183
164049964,1cyclictest5857-21stty08:50:133
164049964,1cyclictest4349-21taskset10:46:433
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional