You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-28 - 20:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Sun Jun 28, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
341992624,1cyclictest62550irq/127-eno112:35:590
352992523,1cyclictest0-21swapper/311:01:493
348992522,3cyclictest0-21swapper/209:53:592
34899250,24cyclictest0-21swapper/211:40:552
346992523,1cyclictest6676-21apt-get09:50:491
346992523,1cyclictest0-21swapper/112:30:491
341992523,1cyclictest0-21swapper/012:17:480
34199250,1cyclictest26519-21diskmemload10:03:350
352992423,1cyclictest5498-21ssh10:18:083
35299240,24cyclictest0-21swapper/309:35:123
35299240,23cyclictest5861-21sh10:47:373
35299240,23cyclictest26519-21diskmemload09:13:563
35299240,23cyclictest0-21swapper/312:28:053
35299240,23cyclictest0-21swapper/311:22:393
35299240,23cyclictest0-21swapper/311:10:563
35299240,1cyclictest0-21swapper/311:26:223
35299240,0cyclictest26519-21diskmemload10:27:443
35299240,0cyclictest26519-21diskmemload10:27:443
348992423,1cyclictest26519-21diskmemload09:28:362
34899240,23cyclictest9574-21ssh10:21:062
34899240,23cyclictest26519-21diskmemload10:51:342
34899240,23cyclictest26519-21diskmemload10:13:292
34899240,23cyclictest0-21swapper/210:57:222
34899240,23cyclictest0-21swapper/209:43:442
346992423,1cyclictest26519-21diskmemload10:50:591
34699240,23cyclictest542-21ssh09:15:501
34699240,23cyclictest28084-21ssh10:09:541
34699240,23cyclictest26519-21diskmemload10:25:321
34699240,23cyclictest26519-21diskmemload10:25:321
34699240,23cyclictest0-21swapper/111:43:091
34699240,23cyclictest0-21swapper/110:24:311
34699240,1cyclictest32493-21taskset12:39:071
34699240,1cyclictest26519-21diskmemload11:10:301
34199240,2cyclictest4222-21rm10:45:570
34199240,24cyclictest0-21swapper/012:07:440
34199240,23cyclictest30838-21ls11:40:000
34199240,23cyclictest26519-21diskmemload10:44:490
34199240,23cyclictest26519-21diskmemload10:25:320
34199240,23cyclictest26519-21diskmemload10:25:320
34199240,23cyclictest0-21swapper/012:33:340
34199240,23cyclictest0-21swapper/012:28:000
34199240,0cyclictest26519-21diskmemload10:24:340
34199240,0cyclictest26519-21diskmemload09:52:140
34199240,0cyclictest0-21swapper/011:42:310
34199240,0cyclictest0-21swapper/011:23:410
352992323,0cyclictest0-21swapper/311:05:513
352992321,2cyclictest34-21ksoftirqd/307:50:003
352992321,1cyclictest0-21swapper/310:10:573
352992321,1cyclictest0-21swapper/310:00:453
352992321,0cyclictest151rcu_preempt12:00:193
35299230,2cyclictest7760-21timerwakeupswit09:20:583
35299230,2cyclictest6688-21ssh09:50:503
35299230,2cyclictest26554-21idleruntime-cro09:10:013
35299230,2cyclictest26158-21sh10:36:033
35299230,23cyclictest26519-21diskmemload09:17:543
35299230,23cyclictest0-21swapper/311:56:303
35299230,22cyclictest7960-21ssh10:50:073
35299230,22cyclictest3221-21ssh11:15:193
35299230,22cyclictest26519-21diskmemload12:36:543
35299230,22cyclictest15410-21sh12:23:293
35299230,22cyclictest11146-21sh09:25:173
35299230,22cyclictest0-21swapper/309:55:043
35299230,0cyclictest151rcu_preempt10:05:333
35299230,0cyclictest0-21swapper/310:55:443
348992323,0cyclictest26519-21diskmemload11:36:072
348992323,0cyclictest22435-21kworker/u8:012:35:322
348992323,0cyclictest0-21swapper/211:15:152
348992323,0cyclictest0-21swapper/210:48:182
348992323,0cyclictest0-21swapper/210:17:102
348992322,1cyclictest0-21swapper/212:34:412
348992321,1cyclictest24987-21rm11:05:492
348992321,1cyclictest0-21swapper/211:55:322
348992321,1cyclictest0-21swapper/211:51:532
348992321,1cyclictest0-21swapper/210:07:092
348992321,1cyclictest0-21swapper/209:38:502
348992319,1cyclictest0-21swapper/212:10:032
34899230,2cyclictest1904-21kworker/u8:210:30:522
34899230,23cyclictest0-21swapper/212:29:002
34899230,23cyclictest0-21swapper/212:07:112
34899230,23cyclictest0-21swapper/210:41:532
34899230,23cyclictest0-21swapper/209:55:392
34899230,22cyclictest26519-21diskmemload09:10:292
34899230,22cyclictest0-21swapper/207:40:012
34899230,1cyclictest0-21swapper/212:17:282
34899230,0cyclictest0-21swapper/211:31:412
346992323,0cyclictest26519-21diskmemload10:03:201
346992322,1cyclictest32707-21ssh09:44:521
346992321,1cyclictest606-21dbus-daemon09:40:001
346992321,1cyclictest28135-21ssh11:07:451
346992321,1cyclictest27126-21ssh11:35:551
346992321,1cyclictest26519-21diskmemload12:00:541
346992321,1cyclictest13094-21apt-get07:35:491
346992321,1cyclictest0-21swapper/111:55:121
346992321,1cyclictest0-21swapper/111:45:201
346992321,1cyclictest0-21swapper/111:30:011
346992321,1cyclictest0-21swapper/109:45:061
346992320,2cyclictest19729-21ssh12:26:461
346992320,2cyclictest14852-21sh09:56:271
34699230,2cyclictest20514-21ssh09:33:221
34699230,23cyclictest26519-21diskmemload10:46:111
34699230,22cyclictest7327-21sh08:30:001
34699230,1cyclictest1638-21ssh10:15:101
34699230,1cyclictest0-21swapper/110:40:011
34699230,0cyclictest26519-21diskmemload10:32:031
34699230,0cyclictest26519-21diskmemload09:25:061
34699230,0cyclictest0-21swapper/109:24:151
341992323,0cyclictest26519-21diskmemload10:33:300
341992323,0cyclictest0-21swapper/011:49:110
341992323,0cyclictest0-21swapper/009:10:090
341992321,1cyclictest7482sleep012:10:510
341992321,1cyclictest19582-21ssh11:29:500
341992321,1cyclictest0-21swapper/009:40:200
34199230,2cyclictest7648-21ssh11:19:070
34199230,2cyclictest2919-21grep09:45:590
34199230,23cyclictest0-21swapper/011:12:120
34199230,23cyclictest0-21swapper/011:01:060
34199230,22cyclictest8399-21sh10:50:490
34199230,22cyclictest10105-21ssh11:50:090
34199230,22cyclictest0-21swapper/012:23:060
34199230,22cyclictest0-21swapper/010:10:020
34199230,22cyclictest0-21swapper/009:26:270
34199230,22cyclictest0-21swapper/008:40:000
34199230,1cyclictest0-21swapper/009:55:020
34199230,1cyclictest0-21swapper/009:33:320
34199230,0cyclictest27745-21ssh10:09:140
34199230,0cyclictest0-21swapper/011:57:110
352992222,0cyclictest0-21swapper/312:30:223
352992221,0cyclictest0-21swapper/311:35:503
352992220,1cyclictest393-21apt-get08:15:503
352992220,1cyclictest27964-21/usr/sbin/munin09:40:543
352992220,1cyclictest15278-21sendmail-msp07:40:013
35299220,22cyclictest0-21swapper/312:06:143
35299220,21cyclictest4332-21ssh12:13:223
35299220,21cyclictest26519-21diskmemload10:40:553
35299220,21cyclictest21883-21sh10:32:503
35299220,21cyclictest20324-21ssh11:30:273
35299220,21cyclictest13098-21ssh11:51:543
35299220,21cyclictest0-21swapper/312:15:403
35299220,21cyclictest0-21swapper/311:40:013
35299220,21cyclictest0-21swapper/309:45:523
35299220,21cyclictest0-21swapper/309:30:093
348992222,0cyclictest0-21swapper/211:01:562
348992222,0cyclictest0-21swapper/210:00:362
348992222,0cyclictest0-21swapper/209:21:492
348992221,1cyclictest9159-21apt-get11:20:502
348992221,1cyclictest1145-21apt-get09:45:502
348992221,0cyclictest0-21swapper/208:05:492
348992220,1cyclictest0-21swapper/211:45:322
34899220,21cyclictest26519-21diskmemload12:20:332
34899220,21cyclictest26519-21diskmemload11:25:372
34899220,21cyclictest0-21swapper/210:25:062
34899220,21cyclictest0-21swapper/210:25:062
34899220,21cyclictest0-21swapper/209:30:152
34899220,21cyclictest0-21swapper/208:15:502
34899220,21cyclictest0-21swapper/208:05:002
34899220,1cyclictest30025-21ssh11:10:102
34899220,1cyclictest25297-21perf08:00:002
34899220,1cyclictest24080-21ssh10:35:382
346992220,1cyclictest30243-21ssh09:12:171
34699220,22cyclictest0-21swapper/112:14:541
34699220,22cyclictest0-21swapper/111:00:061
34699220,21cyclictest6161-21taskset12:15:491
34699220,21cyclictest26519-21diskmemload12:05:101
34699220,21cyclictest26519-21diskmemload11:30:021
34699220,21cyclictest0-21swapper/110:55:051
34699220,21cyclictest0-21swapper/109:10:011
34699220,21cyclictest0-21swapper/108:05:491
34699220,21cyclictest0-21swapper/107:10:511
34699220,1cyclictest30456-21gltestperf10:40:531
34699220,1cyclictest28438-21ssh10:10:021
34699220,1cyclictest25270-21grep08:00:001
34699220,1cyclictest12153-21sendmail-msp08:40:001
34699220,1cyclictest0-21swapper/111:52:151
34699220,1cyclictest0-21swapper/111:16:051
34699220,1cyclictest0-21swapper/109:05:011
341992221,1cyclictest3088-21ssh09:16:590
341992220,1cyclictest22074-21rm12:00:430
341992220,1cyclictest0-21swapper/010:58:440
34199220,22cyclictest23715-21ssh10:35:100
34199220,22cyclictest0-21swapper/011:30:250
34199220,21cyclictest28005-21apt-get08:05:500
34199220,21cyclictest27681-21basename08:05:000
34199220,21cyclictest0-21swapper/009:36:380
34199220,0cyclictest2767-21apt-get07:15:020
34199220,0cyclictest26519-21diskmemload10:15:210
34199220,0cyclictest25045-21apt-get11:05:510
352992120,1cyclictest25611-21apt-get08:00:493
35299210,21cyclictest0-21swapper/307:50:023
35299210,20cyclictest0-21swapper/308:45:513
35299210,1cyclictest5152-21apt-get11:45:513
35299210,0cyclictest0-21swapper/310:20:063
348992121,0cyclictest0-21swapper/208:25:502
34899210,20cyclictest15616-21apt-get07:40:502
34899210,20cyclictest0-21swapper/207:15:022
346992120,1cyclictest8303-21apt-get07:25:511
34699210,20cyclictest0-21swapper/107:40:501
34699210,1cyclictest5906-21apt-get07:20:501
341992120,0cyclictest0-21swapper/007:30:500
341992119,1cyclictest22861-21awk07:55:000
341992119,1cyclictest0-21swapper/009:20:160
34199210,21cyclictest0-21swapper/009:00:010
34199210,1cyclictest0-21swapper/008:30:510
352992020,0cyclictest0-21swapper/307:30:503
348992020,0cyclictest0-21swapper/208:30:512
348992020,0cyclictest0-21swapper/207:20:502
34899200,20cyclictest0-21swapper/207:25:502
346992017,2cyclictest5582-21dump-pmu-power07:20:001
346992017,2cyclictest14558-21munin-plugin-st08:45:001
34699200,0cyclictest0-21swapper/108:50:481
34699200,0cyclictest0-21swapper/108:00:491
341992020,0cyclictest0-21swapper/008:20:500
341992020,0cyclictest0-21swapper/008:15:490
341992020,0cyclictest0-21swapper/007:10:510
341992018,1cyclictest32536-21perf08:15:010
34199200,0cyclictest0-21swapper/008:25:500
352991919,0cyclictest0-21swapper/308:10:513
352991919,0cyclictest0-21swapper/307:25:513
352991919,0cyclictest0-21swapper/307:20:503
341991919,0cyclictest0-21swapper/009:00:520
341991919,0cyclictest0-21swapper/008:40:510
352991818,0cyclictest0-21swapper/308:50:483
352991816,1cyclictest3484-21apt-get07:15:503
352991816,1cyclictest25298-21munin-run08:00:003
35299180,0cyclictest19653-21apt-get08:55:523
348991818,0cyclictest0-21swapper/207:30:512
346991818,0cyclictest0-21swapper/108:45:511
346991816,1cyclictest2554-21sendmail-msp08:20:011
341991818,0cyclictest0-21swapper/007:20:500
352991716,0cyclictest7659-21apt-get08:30:513
35299170,16cyclictest4953-21/usr/sbin/munin08:25:013
348991717,0cyclictest0-21swapper/208:20:492
348991717,0cyclictest0-21swapper/208:10:502
348991715,1cyclictest19348-21munin-run08:55:002
34899170,0cyclictest14864-21apt-get08:45:512
346991717,0cyclictest2864-21apt-get08:20:501
346991716,1cyclictest10699-21apt-get07:30:501
341991717,0cyclictest0-21swapper/007:55:500
341991717,0cyclictest0-21swapper/007:45:500
34199170,2cyclictest16342-21cat08:46:000
352991614,1cyclictest0-21swapper/307:40:583
348991616,0cyclictest0-21swapper/207:50:002
34699160,1cyclictest21806-21munin-run09:00:011
341991614,1cyclictest0-21swapper/007:35:540
352991515,0cyclictest669-21apt-get07:10:513
352991513,1cyclictest0-21swapper/309:00:523
352991513,1cyclictest0-21swapper/308:45:003
34899150,1cyclictest0-21swapper/208:40:532
34899150,14cyclictest0-21swapper/208:35:592
34699150,1cyclictest0-21swapper/107:55:001
341991513,1cyclictest609-21rs:main0
35299140,14cyclictest0-21swapper/308:35:343
35299140,0cyclictest0-21swapper/308:05:043
348991412,1cyclictest22931-21munin-run07:55:002
34899140,14cyclictest0-21swapper/209:07:302
34899140,14cyclictest0-21swapper/209:00:202
34899140,14cyclictest0-21swapper/208:55:442
34899140,0cyclictest0-21swapper/207:10:082
346991414,0cyclictest0-21swapper/108:10:431
34699140,14cyclictest0-21swapper/108:30:231
34699140,0cyclictest0-21swapper/107:45:081
341991414,0cyclictest0-21swapper/007:40:500
34199140,14cyclictest0-21swapper/009:05:060
34199140,14cyclictest0-21swapper/008:52:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional