You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-29 - 17:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Wed Jul 29, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1012499270,1cyclictest0-21swapper/112:33:271
10123992723,4cyclictest4235-21diskmemload09:56:030
1012399270,0cyclictest0-21swapper/009:37:350
10124992620,5cyclictest0-21swapper/109:53:261
10123992621,5cyclictest5523-21ssh11:35:030
1012399260,25cyclictest4235-21diskmemload11:13:070
1012399260,25cyclictest30570-21ssh10:30:390
10126992523,1cyclictest18273-21rm09:51:383
1012699250,1cyclictest4235-21diskmemload09:57:203
10125992523,2cyclictest1778-21sh12:29:532
10125992523,1cyclictest0-21swapper/210:43:282
10124992520,4cyclictest4235-21diskmemload10:05:451
1012499250,24cyclictest0-21swapper/111:44:071
1012499250,24cyclictest0-21swapper/110:50:181
1012499250,21cyclictest4235-21diskmemload10:16:181
1012499250,21cyclictest0-21swapper/109:10:111
1012499250,0cyclictest0-21swapper/109:27:171
10123992521,4cyclictest0-21swapper/010:45:430
10123992520,4cyclictest26855-21ssh10:56:390
1012399250,24cyclictest0-21swapper/012:02:490
1012399250,24cyclictest0-21swapper/011:44:070
1012399250,21cyclictest7572-21ssh12:06:220
1012399250,21cyclictest28998-21ssh11:56:350
1012399250,21cyclictest26865-21ssh11:53:530
1012399250,0cyclictest0-21swapper/010:29:570
10126992422,2cyclictest7034-21sh11:37:163
1012699240,23cyclictest13006-21cpuspeed_turbos09:18:233
1012699240,23cyclictest0-21swapper/309:40:473
1012699240,23cyclictest0-21swapper/309:30:423
1012699240,0cyclictest4235-21diskmemload10:52:493
10125992424,0cyclictest0-21swapper/210:27:462
1012599240,23cyclictest4235-21diskmemload11:25:072
1012599240,23cyclictest4235-21diskmemload09:24:402
1012599240,23cyclictest15654-21grep12:13:302
1012599240,23cyclictest12918-21grep11:13:262
1012599240,23cyclictest0-21swapper/210:30:572
1012599240,23cyclictest0-21swapper/210:06:282
1012599240,1cyclictest4235-21diskmemload11:05:242
10124992423,1cyclictest0-21swapper/111:20:561
10124992421,3cyclictest0-21swapper/111:31:381
10124992421,2cyclictest0-21swapper/111:16:041
10124992421,2cyclictest0-21swapper/110:44:001
1012499240,24cyclictest0-21swapper/112:07:351
1012499240,24cyclictest0-21swapper/111:25:341
1012499240,23cyclictest20570-21expr12:18:261
1012499240,23cyclictest0-21swapper/111:56:351
1012499240,23cyclictest0-21swapper/110:58:011
1012499240,23cyclictest0-21swapper/109:48:271
1012499240,23cyclictest0-21swapper/109:20:371
1012499240,20cyclictest29582-21apt-get09:33:241
1012499240,20cyclictest0-21swapper/111:11:551
1012499240,0cyclictest0-21swapper/112:28:481
1012499240,0cyclictest0-21swapper/112:11:411
1012499240,0cyclictest0-21swapper/111:36:351
1012499240,0cyclictest0-21swapper/111:07:021
10123992423,1cyclictest62550irq/127-eno112:25:450
10123992422,2cyclictest0-21swapper/010:05:140
10123992422,2cyclictest0-21swapper/009:54:430
10123992422,2cyclictest0-21swapper/009:45:220
10123992422,2cyclictest0-21swapper/009:16:340
10123992421,3cyclictest4235-21diskmemload10:13:020
10123992421,2cyclictest0-21swapper/009:24:110
1012399240,24cyclictest0-21swapper/011:30:240
1012399240,23cyclictest0-21swapper/012:30:130
1012399240,23cyclictest0-21swapper/009:30:100
1012399240,21cyclictest21170-21ssh11:48:480
1012399240,21cyclictest0-21swapper/007:30:020
1012399240,1cyclictest4656-21kworker/u8:209:10:150
1012399240,0cyclictest4235-21diskmemload10:50:570
1012399240,0cyclictest0-21swapper/010:44:000
1012399240,0cyclictest0-21swapper/010:36:270
10126992323,0cyclictest30608-21kworker/u8:212:36:573
10126992323,0cyclictest0-21swapper/312:20:073
10126992323,0cyclictest0-21swapper/310:13:243
10126992323,0cyclictest0-21swapper/309:13:353
10126992322,1cyclictest4235-21diskmemload11:20:393
1012699230,2cyclictest30868-21sh10:59:473
1012699230,2cyclictest26516-21ssh10:28:183
1012699230,23cyclictest0-21swapper/312:01:463
1012699230,23cyclictest0-21swapper/310:22:313
1012699230,22cyclictest4235-21diskmemload12:11:363
1012699230,22cyclictest4235-21diskmemload11:51:083
1012699230,22cyclictest4235-21diskmemload11:28:243
1012699230,22cyclictest28278-21ssh10:00:063
1012699230,22cyclictest28042-21sh11:55:153
1012699230,22cyclictest25184-21apt-get08:48:233
1012699230,22cyclictest17016-21ssh10:18:333
1012699230,22cyclictest15927-21sh09:48:383
1012699230,22cyclictest11791-21sh11:11:553
1012699230,22cyclictest0-21swapper/310:06:483
1012699230,0cyclictest4235-21diskmemload12:08:553
1012699230,0cyclictest0-21swapper/311:46:303
1012699230,0cyclictest0-21swapper/311:32:543
1012699230,0cyclictest0-21swapper/309:23:043
10125992323,0cyclictest4235-21diskmemload10:22:132
10125992323,0cyclictest0-21swapper/211:46:232
10125992323,0cyclictest0-21swapper/211:38:252
10125992322,1cyclictest4235-21diskmemload10:11:002
10125992321,1cyclictest16444-21latency_hist11:45:012
10125992321,1cyclictest0-21swapper/210:53:272
10125992321,1cyclictest0-21swapper/210:45:412
10125992321,1cyclictest0-21swapper/210:38:252
10125992321,1cyclictest0-21swapper/210:15:582
1012599230,2cyclictest27824-21dump-pmu-power07:45:012
1012599230,2cyclictest0-21swapper/212:15:452
1012599230,23cyclictest0-21swapper/211:02:482
1012599230,23cyclictest0-21swapper/209:49:252
1012599230,22cyclictest4235-21diskmemload11:55:192
1012599230,22cyclictest0-21swapper/212:37:232
1012599230,22cyclictest0-21swapper/209:31:272
1012599230,0cyclictest4235-21diskmemload10:04:412
1012599230,0cyclictest4235-21diskmemload09:52:042
1012599230,0cyclictest0-21swapper/212:23:152
1012599230,0cyclictest0-21swapper/212:08:082
1012599230,0cyclictest0-21swapper/211:15:452
10124992323,0cyclictest0-21swapper/110:46:571
10124992323,0cyclictest0-21swapper/110:37:501
10124992322,1cyclictest15584-21apt-get08:28:241
10124992321,2cyclictest0-21swapper/109:56:031
10124992321,1cyclictest8442-21ssh12:36:121
10124992321,1cyclictest28841-21rm10:29:081
10124992321,1cyclictest25365-21cron07:40:011
10124992320,3cyclictest0-21swapper/112:01:001
1012499230,23cyclictest0-21swapper/111:45:561
1012499230,23cyclictest0-21swapper/109:41:391
1012499230,23cyclictest0-21swapper/109:38:231
1012499230,22cyclictest23897-21sh12:20:481
1012499230,22cyclictest23311-21sh11:51:281
1012499230,22cyclictest211rcuc/110:30:021
1012499230,1cyclictest4227-21cron09:10:011
1012499230,0cyclictest0-21swapper/110:12:421
10123992323,0cyclictest0-21swapper/011:01:440
10123992323,0cyclictest0-21swapper/010:25:000
10123992322,0cyclictest0-21swapper/009:05:000
10123992320,2cyclictest4235-21diskmemload11:16:150
10123992320,2cyclictest24721-21rm12:21:580
10123992320,2cyclictest10181-21awk11:10:000
1012399230,23cyclictest0-21swapper/012:10:410
1012399230,23cyclictest0-21swapper/011:20:560
1012399230,22cyclictest32313-21sed10:03:340
1012399230,22cyclictest24667-21perf08:45:000
1012399230,22cyclictest14191-21rm10:16:460
1012399230,1cyclictest313-21systemd-journal11:30:000
1012399230,0cyclictest4235-21diskmemload09:42:330
1012399230,0cyclictest0-21swapper/012:38:140
1012399230,0cyclictest0-21swapper/012:16:410
10126992222,0cyclictest4235-21diskmemload10:40:343
10126992222,0cyclictest0-21swapper/309:35:063
10126992220,1cyclictest5528-21apt-get08:08:243
10126992220,1cyclictest0-21swapper/311:15:563
1012699220,21cyclictest774-21runrttasks09:27:133
1012699220,21cyclictest4235-21diskmemload12:25:213
1012699220,21cyclictest2860-21sh12:31:043
1012699220,21cyclictest0-21swapper/307:38:243
1012699220,1cyclictest5451-21ssh11:05:533
1012699220,1cyclictest3967-21ssh10:36:013
1012699220,1cyclictest0-21swapper/311:41:333
1012699220,1cyclictest0-21swapper/310:46:383
10125992222,0cyclictest0-21swapper/209:15:222
10125992221,1cyclictest4235-21diskmemload11:30:272
1012599220,21cyclictest4235-21diskmemload12:00:552
1012599220,21cyclictest4235-21diskmemload11:21:002
1012599220,21cyclictest4235-21diskmemload09:57:492
1012599220,21cyclictest4235-21diskmemload09:36:272
1012599220,21cyclictest4235-21diskmemload09:10:162
1012599220,21cyclictest17312-21apt-get07:25:022
1012599220,21cyclictest0-21swapper/210:56:502
1012599220,1cyclictest0-21swapper/208:50:002
10124992220,1cyclictest1845-21awk09:05:001
1012499220,22cyclictest0-21swapper/111:00:521
1012499220,22cyclictest0-21swapper/110:23:151
1012499220,21cyclictest20119-21perf07:30:001
1012499220,21cyclictest0-21swapper/110:00:381
1012499220,21cyclictest0-21swapper/108:18:231
1012499220,21cyclictest0-21swapper/108:18:231
1012499220,21cyclictest0-21swapper/107:43:241
1012499220,1cyclictest0-21swapper/109:16:221
1012399220,22cyclictest0-21swapper/009:27:550
10126992121,0cyclictest4235-21diskmemload11:00:343
10126992121,0cyclictest28333-21apt-get07:48:243
10126992121,0cyclictest0-21swapper/312:15:273
10126992121,0cyclictest0-21swapper/310:30:043
10126992120,1cyclictest15068-21ls08:25:013
1012699210,0cyclictest0-21swapper/308:33:243
10125992120,1cyclictest4235-21diskmemload12:30:252
10125992120,1cyclictest0-21swapper/207:48:242
10125992120,0cyclictest0-21swapper/208:18:232
10125992120,0cyclictest0-21swapper/208:18:232
1012599210,21cyclictest0-21swapper/209:25:042
1012599210,20cyclictest0-21swapper/208:33:242
1012599210,1cyclictest17329-21munin-run07:25:002
10124992121,0cyclictest0-21swapper/107:53:241
10124992120,0cyclictest25184-21apt-get08:48:231
1012499210,1cyclictest13191-21apt-get08:23:231
10123992120,0cyclictest0-21swapper/007:13:230
1012399210,20cyclictest0-21swapper/007:43:240
1012399210,1cyclictest0-21swapper/007:30:000
1012399210,0cyclictest0-21swapper/008:08:240
1012699200,20cyclictest5012-21perf08:05:003
10125992020,0cyclictest0-21swapper/208:28:242
10125992020,0cyclictest0-21swapper/208:23:232
10125992019,0cyclictest32397-21apt-get09:03:242
10125992019,0cyclictest0-21swapper/207:33:242
1012599200,0cyclictest0-21swapper/209:10:012
10124992020,0cyclictest7920-21apt-get08:13:231
10124992020,0cyclictest0-21swapper/107:58:251
1012499200,0cyclictest0-21swapper/108:53:241
10123992020,0cyclictest0-21swapper/008:28:240
10123992019,0cyclictest0-21swapper/008:58:220
1012399200,20cyclictest0-21swapper/008:13:230
1012399200,0cyclictest0-21swapper/008:23:230
1012399200,0cyclictest0-21swapper/007:58:250
10126991919,0cyclictest13026-21apt-get07:18:253
10126991918,1cyclictest27802-21idleruntime-cro07:45:013
10125991919,0cyclictest0-21swapper/208:03:242
10124991919,0cyclictest0-21swapper/107:18:251
10124991918,0cyclictest0-21swapper/107:13:231
10124991917,1cyclictest5528-21apt-get08:08:241
10124991917,1cyclictest22877-21cron07:35:011
10124991917,1cyclictest0-21swapper/108:58:221
10123991919,0cyclictest0-21swapper/009:08:240
10123991919,0cyclictest0-21swapper/008:33:250
10126991817,1cyclictest687-21apt-get07:58:253
10125991818,0cyclictest29975-21apt-get08:58:222
10125991818,0cyclictest27584-21apt-get08:53:242
10124991818,0cyclictest0-21swapper/108:43:251
10123991818,0cyclictest23407-21file07:38:230
10123991818,0cyclictest0-21swapper/007:23:240
10126991717,0cyclictest0-21swapper/308:28:243
10126991716,0cyclictest20376-21apt-get08:38:233
10126991716,0cyclictest18230-21apt-get07:28:243
10126991715,1cyclictest21018-21apt-get07:33:243
1012699170,1cyclictest4268-21perf09:10:013
10125991714,2cyclictest22283-21basename08:40:002
10124991717,0cyclictest0-21swapper/108:33:251
10123991717,0cyclictest0-21swapper/008:38:230
10126991616,0cyclictest0-21swapper/309:03:243
1012699160,15cyclictest0-21swapper/308:18:233
1012699160,15cyclictest0-21swapper/308:18:233
10123991616,0cyclictest0-21swapper/008:48:230
10123991614,1cyclictest3133-21apt-get08:03:240
10123991614,1cyclictest13542-21fschecks_time07:18:260
10126991515,0cyclictest15442-21apt-get07:23:243
1012699150,14cyclictest0-21swapper/308:53:113
10125991515,0cyclictest0-21swapper/208:15:002
10125991513,1cyclictest23454-21apt-get07:38:242
10124991515,0cyclictest0-21swapper/108:38:231
1012699140,14cyclictest0-21swapper/308:40:043
1012699140,14cyclictest0-21swapper/307:50:083
1012699140,0cyclictest0-21swapper/308:55:093
1012699140,0cyclictest0-21swapper/308:10:453
1012699140,0cyclictest0-21swapper/307:10:443
1012599140,14cyclictest0-21swapper/208:07:112
1012599140,14cyclictest0-21swapper/207:55:252
1012599140,14cyclictest0-21swapper/207:16:282
1012599140,14cyclictest0-21swapper/207:10:352
1012599140,0cyclictest0-21swapper/208:40:082
1012499140,0cyclictest0-21swapper/108:00:081
1012499140,0cyclictest0-21swapper/107:45:391
10123991414,0cyclictest0-21swapper/008:50:330
10123991414,0cyclictest0-21swapper/008:15:120
10123991414,0cyclictest0-21swapper/008:15:120
1012399140,14cyclictest0-21swapper/007:45:030
1012399140,0cyclictest0-21swapper/007:50:350
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional