You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-30 - 08:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat May 30, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1440099260,25cyclictest27701-21cron23:30:003
1440099250,1cyclictest0-21swapper/300:36:453
14394992523,1cyclictest0-21swapper/223:21:252
14394992522,2cyclictest21622-21sh20:30:002
1439499250,2cyclictest8421-21diskmemload22:16:562
1439499250,24cyclictest8421-21diskmemload22:27:552
1439499250,24cyclictest15837-21apt-get21:48:242
14391992522,2cyclictest27707-21cron23:30:001
1439199250,24cyclictest8421-21diskmemload00:16:361
1439199250,24cyclictest21591-21apt-get19:25:011
1439199250,24cyclictest15842-21ssh21:48:231
1439199250,24cyclictest0-21swapper/123:42:271
1438899253,22cyclictest62550irq/127-eno123:32:120
14388992524,1cyclictest0-21swapper/000:36:450
14388992523,1cyclictest62550irq/127-eno123:38:590
14388992522,2cyclictest5751-21ssh00:10:130
1438899251,24cyclictest23255-21kworker/0:222:54:160
14400992423,1cyclictest0-21swapper/323:49:033
1440099240,24cyclictest0-21swapper/323:32:263
1440099240,23cyclictest8421-21diskmemload21:30:283
1440099240,23cyclictest17765-21cut22:50:003
1440099240,23cyclictest0-21swapper/322:55:543
1440099240,23cyclictest0-21swapper/300:28:123
14394992422,1cyclictest0-21swapper/223:03:052
14394992421,2cyclictest622-21gdbus20:45:012
14394992421,2cyclictest622-21gdbus20:45:012
1439499240,24cyclictest0-21swapper/200:14:502
1439499240,23cyclictest8421-21diskmemload23:08:122
1439499240,23cyclictest0-21swapper/223:19:592
1439499240,23cyclictest0-21swapper/222:58:532
1439499240,23cyclictest0-21swapper/222:50:422
1439499240,23cyclictest0-21swapper/222:38:442
1439499240,0cyclictest8421-21diskmemload23:40:562
14391992424,0cyclictest18367-21ssh21:19:131
14391992422,1cyclictest0-21swapper/123:32:051
1439199240,24cyclictest0-21swapper/122:31:591
1439199240,24cyclictest0-21swapper/100:34:191
1439199240,23cyclictest31767-21apt-get20:53:231
1439199240,1cyclictest8421-21diskmemload21:25:381
1439199240,0cyclictest2617-21ssh21:34:481
14388992424,0cyclictest8421-21diskmemload23:25:080
14388992422,2cyclictest23624-21ssh21:54:350
14388992422,1cyclictest22303-21sh00:25:390
14388992421,2cyclictest17762-21perf22:50:000
1438899240,2cyclictest12812-21ssh23:16:140
1438899240,24cyclictest0-21swapper/022:31:290
1438899240,24cyclictest0-21swapper/022:21:010
1438899240,23cyclictest8421-21diskmemload21:11:310
1438899240,23cyclictest0-21swapper/021:42:410
1438899240,1cyclictest0-21swapper/022:14:460
14400992323,0cyclictest0-21swapper/321:54:193
14400992323,0cyclictest0-21swapper/321:19:423
14400992321,2cyclictest8421-21diskmemload21:59:163
14400992321,1cyclictest8421-21diskmemload23:08:283
14400992321,1cyclictest0-21swapper/323:15:063
14400992321,1cyclictest0-21swapper/321:38:283
14400992320,2cyclictest8448-21perf21:10:003
14400992320,2cyclictest313-21systemd-journal19:35:003
14400992320,2cyclictest18457-21ssh22:50:423
1440099231,21cyclictest0-21swapper/322:01:063
1440099231,1cyclictest0-21swapper/321:23:243
1440099230,2cyclictest3802-21diskmemload22:37:323
1440099230,2cyclictest19330-21sh23:22:533
1440099230,22cyclictest8421-21diskmemload22:18:343
1440099230,22cyclictest6517-21sh23:40:263
1440099230,22cyclictest21309-21sh23:54:203
1440099230,22cyclictest0-21swapper/323:55:033
1440099230,22cyclictest0-21swapper/323:11:323
1440099230,22cyclictest0-21swapper/323:00:193
1440099230,22cyclictest0-21swapper/322:43:233
1440099230,0cyclictest0-21swapper/322:13:083
14394992323,0cyclictest0-21swapper/223:57:062
14394992323,0cyclictest0-21swapper/222:12:222
14394992323,0cyclictest0-21swapper/221:27:132
14394992323,0cyclictest0-21swapper/200:30:262
14394992323,0cyclictest0-21swapper/200:23:512
14394992323,0cyclictest0-21swapper/200:02:592
14394992322,1cyclictest8421-21diskmemload23:30:242
14394992322,1cyclictest23500-21kworker/2:021:36:042
14394992321,1cyclictest31253-21perf20:50:012
14394992321,1cyclictest0-21swapper/223:46:342
14394992321,1cyclictest0-21swapper/221:23:282
14394992319,1cyclictest24407-21munin-plugin-st19:30:002
1439499230,23cyclictest8421-21diskmemload21:17:172
1439499230,23cyclictest0-21swapper/222:42:202
1439499230,23cyclictest0-21swapper/221:40:222
1439499230,22cyclictest8421-21diskmemload22:34:332
1439499230,22cyclictest24524-21ssh21:55:292
1439499230,22cyclictest0-21swapper/223:35:302
1439499230,22cyclictest0-21swapper/223:28:322
1439499230,0cyclictest8421-21diskmemload22:45:482
14391992323,0cyclictest8421-21diskmemload23:19:561
14391992323,0cyclictest8421-21diskmemload22:05:031
14391992323,0cyclictest0-21swapper/100:14:111
14391992320,2cyclictest1286-21turbostat23:05:011
1439199230,23cyclictest8421-21diskmemload23:23:341
1439199230,23cyclictest0-21swapper/123:56:341
1439199230,23cyclictest0-21swapper/122:15:211
1439199230,23cyclictest0-21swapper/121:59:421
1439199230,23cyclictest0-21swapper/100:04:511
1439199230,22cyclictest5652-21cstates21:38:251
1439199230,22cyclictest11707-21sh23:45:231
1439199230,0cyclictest0-21swapper/122:50:121
14388992323,0cyclictest8421-21diskmemload23:11:540
14388992323,0cyclictest0-21swapper/023:00:400
14388992323,0cyclictest0-21swapper/022:55:040
14388992323,0cyclictest0-21swapper/021:36:330
14388992323,0cyclictest0-21swapper/000:33:520
14388992321,2cyclictest25363-21ssh23:58:300
14388992321,1cyclictest8421-21diskmemload00:04:360
14388992321,1cyclictest619-21polkitd19:25:000
1438899230,2cyclictest24913-21sh22:26:180
1438899230,23cyclictest916-21ssh22:03:330
1438899230,23cyclictest0-21swapper/022:37:370
1438899230,23cyclictest0-21swapper/021:15:090
1438899230,22cyclictest8421-21diskmemload21:23:410
1438899230,22cyclictest1714-21ssh23:05:170
1438899230,22cyclictest17019-21sh21:48:300
1438899230,22cyclictest12248-21ssh00:16:290
1438899230,22cyclictest0-21swapper/021:30:090
1438899230,1cyclictest313-21systemd-journal19:45:000
1438899230,1cyclictest0-21swapper/022:43:240
1438899230,0cyclictest0-21swapper/022:06:340
14400992222,0cyclictest0-21swapper/300:11:023
14400992220,1cyclictest13824-21runrttasks21:45:203
14400992220,1cyclictest0-21swapper/321:12:123
14400992220,1cyclictest0-21swapper/300:22:343
14400992220,1cyclictest0-21swapper/300:08:413
14400992220,1cyclictest0-21swapper/300:00:183
1440099220,21cyclictest4378-21apt-get19:55:023
1440099220,21cyclictest4167-21apt-get21:03:243
1440099220,21cyclictest25288-21sh22:26:523
1440099220,21cyclictest0-21swapper/323:35:103
1440099220,21cyclictest0-21swapper/322:20:193
1440099220,21cyclictest0-21swapper/322:05:393
1440099220,21cyclictest0-21swapper/300:15:023
1440099220,1cyclictest28859-21apt20:45:013
1440099220,1cyclictest28859-21apt20:45:013
1440099220,1cyclictest0-21swapper/321:40:043
1440099220,1cyclictest0-21swapper/300:31:113
1440099220,0cyclictest0-21swapper/322:30:193
14394992222,0cyclictest8421-21diskmemload23:10:042
14394992222,0cyclictest0-21swapper/223:51:012
14394992222,0cyclictest0-21swapper/222:20:272
14394992222,0cyclictest0-21swapper/221:10:232
14394992221,1cyclictest1747-21apt-get20:58:242
14394992221,1cyclictest0-21swapper/200:27:442
14394992220,1cyclictest2836-21ssh22:05:362
14394992220,1cyclictest1248-21ssh00:36:492
14394992220,0cyclictest0-21swapper/222:01:172
1439499220,22cyclictest0-21swapper/200:08:492
1439499220,21cyclictest0-21swapper/221:30:022
1439499220,21cyclictest0-21swapper/219:53:232
1439499220,1cyclictest8421-21diskmemload21:50:262
1439499220,12cyclictest0-21swapper/219:18:222
14391992222,0cyclictest0-21swapper/123:14:381
14391992222,0cyclictest0-21swapper/122:35:521
14391992222,0cyclictest0-21swapper/122:21:011
14391992222,0cyclictest0-21swapper/122:10:591
14391992222,0cyclictest0-21swapper/122:02:351
14391992222,0cyclictest0-21swapper/121:43:531
14391992222,0cyclictest0-21swapper/100:36:451
14391992222,0cyclictest0-21swapper/100:29:301
14391992221,1cyclictest9310-21ssh21:11:021
14391992220,1cyclictest0-21swapper/122:28:251
1439199220,22cyclictest0-21swapper/123:05:051
1439199220,22cyclictest0-21swapper/122:41:551
1439199220,21cyclictest0-21swapper/123:52:391
1439199220,21cyclictest0-21swapper/123:35:491
1439199220,21cyclictest0-21swapper/119:45:001
1439199220,1cyclictest17591-21sh22:49:381
1439199220,1cyclictest0-21swapper/122:55:381
1439199220,0cyclictest0-21swapper/121:51:051
1439199220,0cyclictest0-21swapper/100:09:081
14388992222,0cyclictest8421-21diskmemload00:07:000
14388992222,0cyclictest0-21swapper/023:21:540
14388992221,1cyclictest8039-21ssh23:42:520
14388992220,1cyclictest0-21swapper/023:50:510
14388992219,2cyclictest26460-21latency_hist20:40:010
1438899220,22cyclictest0-21swapper/021:55:140
1438899220,21cyclictest17156-21ssh00:20:490
1438899220,21cyclictest0-21swapper/021:25:420
1438899220,21cyclictest0-21swapper/020:23:230
1438899220,1cyclictest0-21swapper/019:48:230
1438899220,0cyclictest0-21swapper/022:15:250
14400992120,1cyclictest14899-21apt-get20:18:243
14400992120,1cyclictest0-21swapper/320:53:243
1440099210,20cyclictest0-21swapper/321:25:033
1440099210,1cyclictest21589-21cron19:25:003
1439499210,1cyclictest29186-21cron19:40:002
14391992121,0cyclictest32123-21apt-get19:48:231
14391992119,1cyclictest313-21systemd-journal19:25:001
1439199210,20cyclictest27312-21apt-get19:38:231
1439199210,1cyclictest0-21swapper/120:18:241
1439199210,0cyclictest0-21swapper/100:20:551
1438899210,20cyclictest0-21swapper/020:03:250
14400992020,0cyclictest0-21swapper/320:58:243
14400992020,0cyclictest0-21swapper/319:53:243
1440099200,0cyclictest0-21swapper/320:33:233
14394992019,0cyclictest0-21swapper/220:18:232
14394992018,1cyclictest0-21swapper/220:40:012
1439499200,0cyclictest0-21swapper/219:48:232
14391992020,0cyclictest17316-21apt-get20:23:231
14391992020,0cyclictest0-21swapper/120:03:251
14391992020,0cyclictest0-21swapper/119:53:231
14391992019,1cyclictest28857-21turbostat20:45:011
14391992019,1cyclictest28857-21turbostat20:45:011
1439199200,0cyclictest14862-21apt-get19:13:221
14388992020,0cyclictest0-21swapper/020:33:230
14388992020,0cyclictest0-21swapper/019:55:020
14388992018,1cyclictest0-21swapper/020:18:240
1438899200,0cyclictest0-21swapper/020:28:230
14400991918,0cyclictest0-21swapper/319:13:223
14400991917,2cyclictest14387-21awk20:15:003
14394991919,0cyclictest0-21swapper/220:08:232
14388991919,0cyclictest0-21swapper/021:03:240
14388991919,0cyclictest0-21swapper/019:25:020
14388991918,1cyclictest26793-21turbostat19:35:000
14388991918,0cyclictest0-21swapper/020:58:240
14388991917,1cyclictest2210-21apt-get19:50:020
14394991818,0cyclictest19260-21perf20:25:002
14394991818,0cyclictest0-21swapper/219:23:222
14394991817,0cyclictest5285-21apt-get19:58:222
14394991816,1cyclictest24916-21apt-get19:33:232
14391991818,0cyclictest0-21swapper/121:08:231
14391991818,0cyclictest0-21swapper/120:10:011
14391991816,1cyclictest26783-21cron19:35:001
14388991818,0cyclictest0-21swapper/021:10:000
14388991818,0cyclictest0-21swapper/020:53:240
14400991717,0cyclictest0-21swapper/320:28:243
14400991717,0cyclictest0-21swapper/320:23:233
14400991716,1cyclictest0-21swapper/319:18:223
14394991717,0cyclictest0-21swapper/219:13:222
1439499170,9cyclictest313-21systemd-journal21:10:002
14391991717,0cyclictest22163-21apt-get20:33:231
14391991717,0cyclictest0-21swapper/121:03:241
14391991717,0cyclictest0-21swapper/119:55:021
14391991716,0cyclictest26462-21latency_hist20:40:011
14388991717,0cyclictest0-21swapper/020:43:240
14388991717,0cyclictest0-21swapper/020:43:240
14388991715,1cyclictest14390-21munin-plugin-st20:15:000
14400991616,0cyclictest0-21swapper/319:48:233
14400991615,1cyclictest22517-21apt-get19:28:233
14400991614,1cyclictest0-21swapper/319:43:233
1440099160,15cyclictest783-21snmpd20:06:383
1440099160,15cyclictest29589-21expr20:48:243
14394991616,0cyclictest0-21swapper/220:13:242
14394991614,1cyclictest0-21swapper/220:33:272
14391991615,0cyclictest0-21swapper/120:58:241
14388991616,0cyclictest0-21swapper/019:13:220
14400991512,2cyclictest9581-21latency_hist20:05:013
1440099150,1cyclictest0-21swapper/319:38:283
14394991515,0cyclictest0-21swapper/220:53:242
14391991515,0cyclictest0-21swapper/119:18:221
14388991514,0cyclictest0-21swapper/019:18:300
1439499140,14cyclictest0-21swapper/221:01:232
1439499140,14cyclictest0-21swapper/220:00:462
1439499140,14cyclictest0-21swapper/219:43:312
14388991414,0cyclictest0-21swapper/020:47:140
1438899140,14cyclictest0-21swapper/020:05:420
1438899140,0cyclictest0-21swapper/019:35:490
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional