You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-30 - 10:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sun Aug 30, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27950992928,1cyclictest13-21ksoftirqd/023:37:180
27958992523,1cyclictest13209-21sh23:55:143
2795899250,24cyclictest31163-21awk22:45:003
27956992523,1cyclictest7723-21ssh23:50:252
27956992520,4cyclictest8082-21ssh22:23:572
2795699250,24cyclictest8625-21ssh00:20:082
2795699250,1cyclictest5992-21ssh21:24:122
2795399250,24cyclictest0-21swapper/122:21:441
2795099252,23cyclictest62550irq/127-eno100:23:470
2795099250,24cyclictest17123-21ssh00:26:470
27958992422,1cyclictest26317-21rm23:09:033
27956992424,0cyclictest0-21swapper/222:19:542
2795699241,1cyclictest28450-21idleruntime-cro23:40:002
2795699240,2cyclictest13402-21rm23:26:042
2795699240,23cyclictest0-21swapper/223:24:482
2795699240,21cyclictest0-21swapper/223:02:262
27953992423,1cyclictest21595-21diskmemload22:05:591
27953992422,1cyclictest0-21swapper/123:06:171
27953992422,1cyclictest0-21swapper/122:02:151
2795399240,24cyclictest0-21swapper/122:32:391
2795399240,23cyclictest3934-21ssh23:17:141
2795399240,23cyclictest21595-21diskmemload00:11:091
2795399240,23cyclictest0-21swapper/100:20:461
2795399240,0cyclictest0-21swapper/123:33:051
27950992424,0cyclictest0-21swapper/000:39:110
27950992423,1cyclictest0-21swapper/022:38:070
27950992422,1cyclictest3380-21sh22:48:450
27950992422,1cyclictest21595-21diskmemload21:28:120
27950992422,1cyclictest0-21swapper/000:05:570
27950992421,2cyclictest17195-21sh23:30:000
2795099240,24cyclictest0-21swapper/021:31:560
2795099240,23cyclictest6887-21apt-get23:21:010
2795099240,23cyclictest0-21swapper/022:51:570
2795099240,23cyclictest0-21swapper/021:38:350
2795099240,0cyclictest0-21swapper/022:15:580
27958992323,0cyclictest0-21swapper/323:44:313
27958992323,0cyclictest0-21swapper/323:18:403
27958992323,0cyclictest0-21swapper/322:46:333
27958992323,0cyclictest0-21swapper/322:04:253
27958992323,0cyclictest0-21swapper/321:35:323
27958992323,0cyclictest0-21swapper/300:24:113
27958992322,1cyclictest21595-21diskmemload00:09:223
27958992322,1cyclictest14229-21sh22:29:463
27958992321,1cyclictest7202-21ssh22:22:453
27958992321,1cyclictest17925-21sh22:32:113
27958992321,1cyclictest1129-21sh21:20:003
27958992320,2cyclictest28034-21ssh23:10:593
27958992320,2cyclictest22311-21sh22:06:553
2795899230,2cyclictest23008-21sh22:36:303
2795899230,23cyclictest0-21swapper/323:28:043
2795899230,22cyclictest29572-21perf20:20:003
2795899230,22cyclictest23763-21ssh00:33:223
2795899230,22cyclictest19656-21wc23:31:093
2795899230,22cyclictest12948-21apt22:00:003
2795899230,22cyclictest12881-21ssh22:56:273
2795899230,0cyclictest0-21swapper/322:19:523
2795899230,0cyclictest0-21swapper/300:36:103
27956992323,0cyclictest0-21swapper/223:11:472
27956992323,0cyclictest0-21swapper/221:54:212
27956992323,0cyclictest0-21swapper/221:33:322
27956992323,0cyclictest0-21swapper/200:26:082
27956992323,0cyclictest0-21swapper/200:03:532
27956992321,1cyclictest21595-21diskmemload21:16:052
27956992321,1cyclictest0-21swapper/223:15:562
27956992321,1cyclictest0-21swapper/222:31:022
27956992321,0cyclictest0-21swapper/222:14:352
27956992321,0cyclictest0-21swapper/222:14:352
2795699230,23cyclictest0-21swapper/222:41:332
2795699230,23cyclictest0-21swapper/222:37:172
2795699230,23cyclictest0-21swapper/221:25:372
2795699230,22cyclictest9948-21sh19:40:002
2795699230,22cyclictest23589-21sh00:33:012
2795699230,22cyclictest21595-21diskmemload21:10:562
2795699230,22cyclictest14000-21ssh22:58:032
2795699230,22cyclictest11633-21munin-run20:50:012
2795699230,22cyclictest0-21swapper/200:05:412
2795699230,0cyclictest21595-21diskmemload23:41:202
2795699230,0cyclictest0-21swapper/220:55:592
2795699230,0cyclictest0-21swapper/200:11:362
27953992323,0cyclictest0-21swapper/123:51:071
27953992323,0cyclictest0-21swapper/122:50:071
27953992323,0cyclictest0-21swapper/122:45:151
27953992323,0cyclictest0-21swapper/121:51:211
27953992323,0cyclictest0-21swapper/121:44:361
27953992321,1cyclictest30090-21/usr/sbin/munin21:46:011
27953992321,1cyclictest29110-21sh22:13:471
27953992321,1cyclictest29110-21sh22:13:471
27953992321,1cyclictest11596-21cron20:50:011
27953992321,1cyclictest0-21swapper/123:26:141
2795399230,23cyclictest0-21swapper/122:39:521
2795399230,23cyclictest0-21swapper/121:24:501
2795399230,23cyclictest0-21swapper/121:11:241
2795399230,22cyclictest19283-21ssh00:00:471
2795399230,22cyclictest15052-21/usr/sbin/munin23:56:051
2795399230,22cyclictest11212-21ssh21:57:331
2795399230,22cyclictest0-21swapper/122:41:101
2795399230,22cyclictest0-21swapper/121:05:001
2795399230,1cyclictest0-21swapper/123:46:141
2795399230,1cyclictest0-21swapper/100:32:411
2795399230,0cyclictest0-21swapper/122:19:211
27950992323,0cyclictest0-21swapper/023:08:350
27950992323,0cyclictest0-21swapper/021:10:060
27950992322,1cyclictest62550irq/127-eno100:14:240
27950992322,1cyclictest0-21swapper/023:18:430
27950992322,0cyclictest0-21swapper/022:22:240
27950992321,1cyclictest29892-21sh23:11:090
27950992321,1cyclictest2395-21sh21:50:300
27950992321,1cyclictest0-21swapper/022:05:080
2795099230,22cyclictest32711-21rm21:47:480
2795099230,22cyclictest23812-21ssh00:33:260
2795099230,22cyclictest19264-21sh23:02:380
2795099230,22cyclictest0-21swapper/021:23:370
2795099230,21cyclictest18995-21ssh00:00:170
2795099230,1cyclictest0-21swapper/023:56:340
2795099230,0cyclictest0-21swapper/023:40:200
2795099230,0cyclictest0-21swapper/022:00:510
2795099230,0cyclictest0-21swapper/021:40:330
27958992222,0cyclictest0-21swapper/321:26:083
27958992221,1cyclictest0-21swapper/322:11:113
27958992221,1cyclictest0-21swapper/322:11:113
27958992220,1cyclictest11950-21apt-get20:50:593
27958992220,1cyclictest0-21swapper/323:50:173
27958992220,1cyclictest0-21swapper/323:20:073
27958992220,1cyclictest0-21swapper/321:22:213
27958992220,1cyclictest0-21swapper/320:15:003
2795899220,22cyclictest0-21swapper/321:13:323
2795899220,21cyclictest4548-21ssh22:50:033
2795899220,21cyclictest2779-21munin-run19:25:003
2795899220,21cyclictest22695-21apt-get20:05:583
2795899220,21cyclictest21595-21diskmemload00:00:083
2795899220,21cyclictest0-21swapper/320:30:593
2795899220,1cyclictest29622-21ssh21:45:593
2795899220,1cyclictest12899-21ssh21:30:473
2795899220,1cyclictest0-21swapper/321:50:373
2795899220,1cyclictest0-21swapper/321:40:313
2795899220,1cyclictest0-21swapper/300:30:003
2795899220,1cyclictest0-21swapper/300:15:513
2795899220,1cyclictest0-21swapper/300:10:163
27956992222,0cyclictest21595-21diskmemload22:50:132
27956992222,0cyclictest0-21swapper/222:05:362
27956992221,0cyclictest5492-21apt-get19:30:592
27956992220,1cyclictest5534-21ssh00:16:152
27956992220,1cyclictest19928-21ssh23:31:102
27956992220,1cyclictest14016-21awk20:55:012
27956992220,1cyclictest0-21swapper/223:57:052
2795699220,21cyclictest9117-21ssh22:25:072
2795699220,21cyclictest8311-21sh21:55:552
2795699220,21cyclictest27483-21apt-get20:15:582
2795699220,21cyclictest25573-21rm00:35:292
2795699220,21cyclictest21595-21diskmemload22:46:042
2795699220,21cyclictest17171-21apt19:55:012
2795699220,21cyclictest0-21swapper/223:45:512
2795699220,1cyclictest29377-21ssh21:45:402
2795699220,1cyclictest18458-21ssh21:35:412
2795699220,1cyclictest0-21swapper/221:40:272
27953992222,0cyclictest21595-21diskmemload23:13:491
27953992220,1cyclictest0-21swapper/121:31:021
2795399220,21cyclictest3704-21apt-get00:15:581
2795399220,21cyclictest19567-21apt20:00:011
2795399220,21cyclictest18806-21chrt00:29:091
2795399220,21cyclictest0-21swapper/123:00:431
2795399220,21cyclictest0-21swapper/121:36:031
2795399220,21cyclictest0-21swapper/121:26:001
2795399220,21cyclictest0-21swapper/120:15:001
2795399220,1cyclictest9972-21perf19:40:001
2795399220,1cyclictest21595-21diskmemload22:56:001
2795399220,1cyclictest21595-21diskmemload00:06:001
2795399220,1cyclictest0-21swapper/123:40:161
2795399220,1cyclictest0-21swapper/123:38:051
2795399220,0cyclictest0-21swapper/100:36:571
27950992222,0cyclictest21595-21diskmemload22:42:040
27950992222,0cyclictest0-21swapper/023:31:000
27950992222,0cyclictest0-21swapper/022:56:330
27950992222,0cyclictest0-21swapper/022:25:270
27950992222,0cyclictest0-21swapper/021:15:060
27950992222,0cyclictest0-21swapper/000:15:230
27950992221,1cyclictest7265-21kworker/0:121:55:590
27950992220,1cyclictest30358-21idleruntime-cro19:15:010
27950992220,1cyclictest0-21swapper/019:36:000
2795099220,21cyclictest21595-21diskmemload23:45:530
2795099220,21cyclictest0-21swapper/020:55:010
2795099220,1cyclictest29985-21ssh22:14:540
2795099220,1cyclictest29985-21ssh22:14:540
2795099220,1cyclictest0-21swapper/022:33:140
2795099220,0cyclictest0-21swapper/023:52:410
27958992121,0cyclictest7157-21apt-get20:40:573
27958992121,0cyclictest0-21swapper/323:36:023
27958992119,1cyclictest325-21munin-run19:20:003
2795899210,1cyclictest3094-21apt-get19:25:583
2795899210,0cyclictest21595-21diskmemload23:00:083
27956992120,1cyclictest21616-21perf21:10:002
27956992120,1cyclictest17156-21apt-get21:00:572
2795699210,20cyclictest30354-21basename19:15:012
2795699210,0cyclictest0-21swapper/222:01:032
27953992121,0cyclictest0-21swapper/120:55:021
27953992121,0cyclictest0-21swapper/120:35:591
27953992121,0cyclictest0-21swapper/120:35:591
27953992121,0cyclictest0-21swapper/119:45:591
2795399210,21cyclictest0-21swapper/121:15:321
2795399210,0cyclictest0-21swapper/119:11:051
27950992121,0cyclictest0-21swapper/020:10:590
2795099210,21cyclictest0-21swapper/020:20:590
2795099210,21cyclictest0-21swapper/019:25:000
2795099210,20cyclictest19905-21apt-get20:00:580
2795099210,20cyclictest0-21swapper/020:30:590
2795099210,0cyclictest0-21swapper/020:55:590
27958992019,1cyclictest10305-21apt-get19:40:583
27958992019,0cyclictest28252-21apt-get19:11:053
2795899200,0cyclictest0-21swapper/321:06:003
27956992020,0cyclictest0-21swapper/220:05:022
27956992020,0cyclictest0-21swapper/220:00:582
27956992020,0cyclictest0-21swapper/219:15:582
2795699200,19cyclictest605-21avahi-daemon20:35:002
2795399200,0cyclictest19551-21apt-get21:05:591
2795399200,0cyclictest0-21swapper/120:30:591
27950992019,0cyclictest0-21swapper/019:25:580
27950992018,1cyclictest17156-21apt-get21:00:570
2795099200,0cyclictest0-21swapper/019:30:590
27958991919,0cyclictest0-21swapper/320:20:593
27958991918,1cyclictest0-21swapper/320:00:013
27953991919,0cyclictest0-21swapper/120:25:581
27953991918,0cyclictest0-21swapper/120:15:581
27953991917,1cyclictest30693-21apt-get19:15:581
27953991917,1cyclictest0-21swapper/119:30:001
27950991919,0cyclictest0-21swapper/019:40:580
27958991818,0cyclictest32362-21apt-get20:25:583
27958991816,1cyclictest313-21systemd-journal19:40:003
2795899180,0cyclictest0-21swapper/320:00:583
27956991818,0cyclictest4745-21apt-get20:35:592
27956991818,0cyclictest4745-21apt-get20:35:592
27956991818,0cyclictest0-21swapper/220:20:592
27956991818,0cyclictest0-21swapper/219:55:592
27956991817,1cyclictest0-21swapper/220:40:572
27956991817,1cyclictest0-21swapper/219:45:592
27953991817,1cyclictest11950-21apt-get20:50:591
2795399180,0cyclictest15096-21apt-get19:50:591
27950991818,0cyclictest0-21swapper/020:45:580
27950991818,0cyclictest0-21swapper/020:35:590
27950991818,0cyclictest0-21swapper/020:35:590
27958991717,0cyclictest0-21swapper/319:30:593
27958991716,1cyclictest9553-21apt-get20:45:583
27956991717,0cyclictest0-21swapper/219:20:592
27953991717,0cyclictest0-21swapper/119:21:001
27950991717,0cyclictest0-21swapper/020:05:580
27950991715,1cyclictest1649-21cron19:55:010
27956991614,2cyclictest25056-21/usr/sbin/munin20:11:102
27953991614,1cyclictest29914-21apt-get20:20:591
27958991513,1cyclictest19222-21awk21:05:003
27958991513,1cyclictest17135-21cron19:55:013
2795899140,14cyclictest0-21swapper/319:47:123
2795899140,0cyclictest0-21swapper/320:36:253
2795899140,0cyclictest0-21swapper/320:36:253
2795699140,14cyclictest0-21swapper/220:27:452
2795699140,14cyclictest0-21swapper/219:25:092
2795699140,0cyclictest0-21swapper/219:40:022
2795399142,5cyclictest11332-21/usr/sbin/munin19:41:031
27953991414,0cyclictest0-21swapper/120:40:151
27953991414,0cyclictest0-21swapper/120:01:271
27950991414,0cyclictest0-21swapper/021:06:110
27950991414,0cyclictest0-21swapper/020:16:560
27950991414,0cyclictest0-21swapper/019:55:030
2795099140,14cyclictest0-21swapper/020:40:400
2795099140,14cyclictest0-21swapper/019:15:180
2795099140,0cyclictest0-21swapper/020:25:430
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional