You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-14 - 03:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Tue Apr 14, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27134992624,1cyclictest11860-21apt-get21:34:343
27134992523,1cyclictest13528-21sh22:06:243
2713499250,24cyclictest20370-21diskmemload23:46:473
27129992522,2cyclictest20914-21sh22:44:431
27129992522,2cyclictest18991-21perf21:40:011
2712999250,1cyclictest18074-21idleruntime-cro23:45:001
27124992523,1cyclictest17599-21sh21:39:360
27134992423,1cyclictest0-21swapper/321:11:453
27134992422,1cyclictest22034-21sh22:46:053
27134992422,1cyclictest0-21swapper/323:20:433
2713499240,23cyclictest20370-21diskmemload21:28:083
2713499240,23cyclictest0-21swapper/323:14:123
27131992422,1cyclictest0-21swapper/221:49:202
27131992419,4cyclictest0-21swapper/223:51:062
27131992419,4cyclictest0-21swapper/221:53:472
2713199240,23cyclictest20370-21diskmemload23:25:122
2713199240,23cyclictest0-21swapper/222:35:062
2713199240,23cyclictest0-21swapper/222:18:142
2713199240,23cyclictest0-21swapper/200:06:452
2713199240,1cyclictest0-21swapper/223:42:402
2713199240,1cyclictest0-21swapper/222:55:012
2713199240,1cyclictest0-21swapper/222:09:392
27129992423,1cyclictest0-21swapper/123:26:111
2712999240,23cyclictest5510-21ssh23:34:151
2712999240,23cyclictest20370-21diskmemload23:04:551
2712999240,23cyclictest18605-21apt-get21:09:341
27124992423,1cyclictest20370-21diskmemload23:26:200
27124992421,2cyclictest20370-21diskmemload22:39:350
2712499240,24cyclictest0-21swapper/000:38:420
2712499240,23cyclictest4151-21rm23:31:580
2712499240,23cyclictest29597-21rm00:28:340
2712499240,23cyclictest0-21swapper/000:31:540
2712499240,0cyclictest0-21swapper/021:56:220
27134992323,0cyclictest0-21swapper/323:27:363
27134992321,1cyclictest32392-21cpuspeed_turbos21:54:353
27134992321,1cyclictest0-21swapper/321:17:253
27134992320,2cyclictest30886-21ssh23:58:593
27134992320,2cyclictest19015-21sh22:11:223
2713499230,2cyclictest2101-21sh00:01:243
2713499230,23cyclictest20370-21diskmemload22:40:503
2713499230,23cyclictest1770-21ssh22:26:153
2713499230,23cyclictest0-21swapper/322:16:453
2713499230,22cyclictest9885-21if_enp1s000:09:373
2713499230,22cyclictest27543-21sh00:25:123
2713499230,22cyclictest22287-21ssh00:20:383
2713499230,22cyclictest20370-21diskmemload21:45:393
2713499230,0cyclictest0-21swapper/323:03:593
2713499230,0cyclictest0-21swapper/321:22:053
27131992323,0cyclictest0-21swapper/223:39:362
27131992323,0cyclictest0-21swapper/222:20:452
27131992323,0cyclictest0-21swapper/221:13:552
27131992323,0cyclictest0-21swapper/200:28:132
27131992322,1cyclictest0-21swapper/222:45:192
27131992321,1cyclictest0-21swapper/223:01:542
27131992320,0cyclictest0-21swapper/222:50:352
2713199230,23cyclictest0-21swapper/223:45:092
2713199230,23cyclictest0-21swapper/200:03:002
2713199230,22cyclictest0-21swapper/200:11:012
2713199230,0cyclictest20370-21diskmemload21:41:552
2713199230,0cyclictest0-21swapper/222:31:322
27129992323,0cyclictest0-21swapper/121:32:551
27129992323,0cyclictest0-21swapper/120:04:301
27129992323,0cyclictest0-21swapper/100:19:111
27129992321,1cyclictest5959-21awk20:40:001
27129992321,1cyclictest25749-21sh22:19:041
27129992321,1cyclictest23083-21sh23:49:591
27129992321,1cyclictest0-21swapper/121:12:371
27129992321,1cyclictest0-21swapper/100:02:011
27129992320,2cyclictest5015-21latency_hist00:35:001
27129992320,2cyclictest29986-21sh21:50:591
2712999230,2cyclictest32723-21sh22:56:111
2712999230,23cyclictest20370-21diskmemload23:50:311
2712999230,23cyclictest0-21swapper/121:18:421
2712999230,22cyclictest9107-21ssh22:03:011
2712999230,22cyclictest28092-21sh00:26:091
2712999230,22cyclictest27969-21ssh22:52:231
2712999230,22cyclictest2005-21sh21:24:381
2712999230,22cyclictest18571-21ssh23:14:371
2712999230,22cyclictest18216-21dpkg22:10:031
2712999230,22cyclictest12729-21ssh00:12:111
2712999230,22cyclictest11891-21grep19:45:001
2712999230,22cyclictest0-21swapper/100:07:311
2712999230,1cyclictest30299-21diskmemload23:57:571
2712999230,0cyclictest0-21swapper/123:36:041
2712999230,0cyclictest0-21swapper/122:34:131
2712999230,0cyclictest0-21swapper/121:41:551
27124992322,1cyclictest62550irq/127-eno121:50:060
27124992322,1cyclictest62550irq/127-eno121:29:580
27124992320,2cyclictest25840-21ssh22:19:130
2712499230,23cyclictest20370-21diskmemload22:56:490
2712499230,23cyclictest20370-21diskmemload00:15:440
2712499230,23cyclictest0-21swapper/023:41:580
2712499230,23cyclictest0-21swapper/021:16:300
2712499230,23cyclictest0-21swapper/021:11:430
2712499230,22cyclictest30985-21ssh21:20:190
2712499230,22cyclictest30082-21ssh22:22:480
2712499230,22cyclictest18422-21sh22:10:210
2712499230,22cyclictest16320-21ssh22:40:040
2712499230,1cyclictest0-21swapper/000:13:130
2712499230,0cyclictest0-21swapper/023:06:380
2712499230,0cyclictest0-21swapper/022:45:410
27134992222,0cyclictest0-21swapper/322:56:153
27134992222,0cyclictest0-21swapper/322:32:493
27134992222,0cyclictest0-21swapper/321:55:233
27134992222,0cyclictest0-21swapper/300:12:193
27134992221,1cyclictest0-21swapper/323:35:023
27134992220,1cyclictest17614-21ssh00:16:143
2713499220,22cyclictest0-21swapper/300:31:053
2713499220,21cyclictest8950-21apt-get20:49:333
2713499220,21cyclictest7738-21ssh22:00:513
2713499220,21cyclictest606-21dbus-daemon21:00:013
2713499220,21cyclictest31903-21perf19:20:013
2713499220,21cyclictest20370-21diskmemload23:50:493
2713499220,21cyclictest20370-21diskmemload23:31:283
2713499220,21cyclictest20312-21sh23:15:363
2713499220,21cyclictest13960-21ssh23:41:203
2713499220,21cyclictest10390-21ssh23:05:583
2713499220,21cyclictest0-21swapper/322:50:033
2713499220,21cyclictest0-21swapper/322:20:333
2713499220,21cyclictest0-21swapper/320:04:313
2713499220,21cyclictest0-21swapper/319:34:333
2713499220,21cyclictest0-21swapper/319:25:023
2713499220,1cyclictest20370-21diskmemload00:37:403
2713499220,1cyclictest14793-21ssh21:36:103
2713499220,0cyclictest0-21swapper/320:09:333
27131992222,0cyclictest0-21swapper/221:56:102
27131992221,1cyclictest20370-21diskmemload22:00:272
27131992220,1cyclictest0-21swapper/223:30:472
27131992220,1cyclictest0-21swapper/222:40:332
27131992220,1cyclictest0-21swapper/221:20:152
27131992220,1cyclictest0-21swapper/219:50:002
27131992220,1cyclictest0-21swapper/200:21:062
2713199221,20cyclictest28-21ksoftirqd/221:15:102
2713199220,22cyclictest20370-21diskmemload23:10:592
2713199220,21cyclictest20370-21diskmemload21:35:252
2713199220,21cyclictest19181-21sh00:18:522
2713199220,21cyclictest0-21swapper/223:21:132
2713199220,21cyclictest0-21swapper/222:30:002
2713199220,21cyclictest0-21swapper/221:27:562
2713199220,21cyclictest0-21swapper/200:35:002
2713199220,1cyclictest20874-1kworker/u9:222:12:272
2713199220,1cyclictest0-21swapper/223:55:452
2713199220,1cyclictest0-21swapper/221:30:052
2713199220,0cyclictest0-21swapper/200:35:062
27129992222,0cyclictest0-21swapper/122:09:361
27129992222,0cyclictest0-21swapper/121:55:041
27129992221,1cyclictest26478-21ssh23:22:101
27129992221,1cyclictest0-21swapper/121:45:311
27129992220,1cyclictest0-21swapper/122:22:031
27129992219,2cyclictest21484-21sh22:45:051
2712999220,21cyclictest0-21swapper/123:15:081
2712999220,21cyclictest0-21swapper/123:05:221
2712999220,21cyclictest0-21swapper/122:35:031
2712999220,21cyclictest0-21swapper/100:20:261
2712999220,1cyclictest3585-21sh21:25:061
2712999220,1cyclictest1091-21ssh22:25:081
2712999220,1cyclictest0-21swapper/100:35:491
27124992222,0cyclictest20370-21diskmemload00:00:160
27124992222,0cyclictest0-21swapper/023:55:150
27124992222,0cyclictest0-21swapper/022:25:040
27124992222,0cyclictest0-21swapper/019:34:330
27124992221,1cyclictest20370-21diskmemload23:38:020
27124992221,1cyclictest20370-21diskmemload22:30:120
27124992221,1cyclictest16953-21ssh23:13:170
27124992220,1cyclictest0-21swapper/021:05:010
2712499220,22cyclictest0-21swapper/022:50:090
2712499220,21cyclictest25699-21ssh23:21:010
2712499220,21cyclictest22462-21ssh00:20:540
2712499220,21cyclictest20370-21diskmemload00:05:460
2712499220,21cyclictest19487-21ssh21:40:240
2712499220,21cyclictest0-21swapper/022:00:130
2712499220,21cyclictest0-21swapper/021:45:110
2712499220,1cyclictest20630-21ssh23:16:040
2712499220,1cyclictest20370-21diskmemload23:03:260
2712499220,1cyclictest13816-21ssh22:06:550
2712499220,0cyclictest0-21swapper/023:45:570
2712499220,0cyclictest0-21swapper/021:09:350
27134992121,0cyclictest20370-21diskmemload22:35:513
2713499210,21cyclictest19765-21kworker/u8:221:41:163
2713499210,21cyclictest0-21swapper/320:29:343
27131992121,0cyclictest0-21swapper/223:15:512
27131992120,0cyclictest27691-21apt-get19:14:312
27131992119,1cyclictest17983-21sh21:05:012
2713199210,21cyclictest0-21swapper/223:05:422
2713199210,20cyclictest6557-21apt-get20:44:332
2713199210,20cyclictest0-21swapper/219:24:342
2713199210,1cyclictest0-21swapper/220:49:332
27129992121,0cyclictest0-21swapper/120:14:331
27129992119,1cyclictest32507-21apt-get19:24:341
27129992119,1cyclictest1887-21apt-get19:25:021
27129992119,1cyclictest0-21swapper/119:20:011
2712999210,20cyclictest0-21swapper/120:59:331
2712999210,1cyclictest31153-21perf20:25:001
2712999210,1cyclictest0-21swapper/120:35:001
2712999210,0cyclictest0-21swapper/120:49:331
2712499210,21cyclictest0-21swapper/023:50:160
2712499210,21cyclictest0-21swapper/020:34:330
2712499210,20cyclictest0-21swapper/020:24:350
2712499210,1cyclictest8335-21dump-pmu-power20:45:000
2712499210,0cyclictest0-21swapper/019:14:310
27134992020,0cyclictest0-21swapper/320:44:333
27134992020,0cyclictest0-21swapper/320:39:343
27134992020,0cyclictest0-21swapper/320:24:343
27134992018,1cyclictest11869-21apt19:45:003
27131992020,0cyclictest19748-21apt-get20:04:312
2712999200,0cyclictest0-21swapper/119:14:311
27124992018,1cyclictest0-21swapper/020:00:010
2712499200,20cyclictest0-21swapper/020:59:320
2712499200,20cyclictest0-21swapper/019:29:330
2712499200,0cyclictest0-21swapper/019:19:320
27134991919,0cyclictest0-21swapper/320:19:333
27134991917,1cyclictest606-21dbus-daemon19:40:003
27134991917,1cyclictest0-21swapper/321:05:013
27131991919,0cyclictest0-21swapper/220:19:332
27131991919,0cyclictest0-21swapper/219:54:332
27131991918,1cyclictest2888-21apt-get19:29:332
27131991918,0cyclictest29361-21apt-get20:24:342
27129991919,0cyclictest0-21swapper/120:54:331
27129991919,0cyclictest0-21swapper/120:19:331
27129991917,1cyclictest0-21swapper/120:10:011
27124991919,0cyclictest26936-21apt-get20:19:330
27124991919,0cyclictest0-21swapper/020:54:330
27134991818,0cyclictest17333-21apt-get19:59:333
27134991818,0cyclictest11347-21apt-get20:54:333
27134991818,0cyclictest0-21swapper/321:09:343
27134991818,0cyclictest0-21swapper/319:14:313
27131991818,0cyclictest0-21swapper/220:14:342
27131991818,0cyclictest0-21swapper/219:19:322
27131991817,0cyclictest0-21swapper/219:34:332
27131991816,1cyclictest19134-21latency_hist20:00:012
27129991818,0cyclictest0-21swapper/120:29:341
27129991818,0cyclictest0-21swapper/119:59:331
27129991818,0cyclictest0-21swapper/119:40:001
2712999180,6cyclictest0-21swapper/119:54:331
27124991816,1cyclictest26340-21perf20:15:010
27124991816,1cyclictest1106-21ls20:30:000
27131991717,0cyclictest4141-21apt-get20:39:342
27131991717,0cyclictest0-21swapper/219:44:332
2713199170,17cyclictest0-21swapper/221:09:342
27124991717,0cyclictest0-21swapper/019:39:330
27134991616,0cyclictest0-21swapper/320:34:333
27131991614,1cyclictest15502-21cron21:00:012
2712499160,14cyclictest0-21swapper/020:35:520
27134991515,0cyclictest0-21swapper/319:54:333
27134991514,1cyclictest0-21swapper/319:25:013
27131991515,0cyclictest0-21swapper/220:54:342
27124991513,1cyclictest313-21systemd-journal20:05:010
27124991513,1cyclictest23863-21users20:09:430
2712499150,14cyclictest0-21swapper/019:51:090
27134991414,0cyclictest0-21swapper/320:10:033
2713499140,0cyclictest0-21swapper/319:45:413
2713199140,14cyclictest0-21swapper/220:30:222
2713199140,14cyclictest0-21swapper/220:25:592
2713199140,14cyclictest0-21swapper/220:05:032
2713199140,0cyclictest0-21swapper/219:35:142
2712999140,14cyclictest0-21swapper/121:00:371
2712999140,14cyclictest0-21swapper/119:45:281
27124991414,0cyclictest0-21swapper/019:40:080
2712499140,0cyclictest0-21swapper/019:45:590
2712499140,0cyclictest0-21swapper/019:21:350
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional