You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-08 - 08:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Mon Jun 08, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2013521450,5sleep12636199cyclictest22:30:481
26076211086,19sleep00-21swapper/019:06:400
26227210897,6sleep20-21swapper/219:08:382
24824210884,17sleep10-21swapper/119:05:121
24541210480,19sleep30-21swapper/319:05:063
268572750,0sleep00-21swapper/022:03:420
60932740,0sleep00-21swapper/000:35:290
281562730,1sleep10-21swapper/123:50:051
262562700,0sleep20-21swapper/223:47:132
228252280,1sleep1221ktimersoftd/121:59:421
2636299230,21cyclictest0-21swapper/220:20:122
72322220,0sleep10-21swapper/121:04:551
52772220,0sleep10-21swapper/121:40:141
26362992218,2cyclictest0-21swapper/219:50:112
2636099212,7cyclictest0-21swapper/019:32:580
26360992111,8cyclictest9290-21diskmemload23:15:170
2636099210,19cyclictest0-21swapper/020:25:130
2636099210,19cyclictest0-21swapper/020:20:120
2636099208,3cyclictest0-21swapper/021:36:040
2636099202,7cyclictest0-21swapper/021:04:590
2636099200,1cyclictest0-21swapper/023:25:110
2636099199,2cyclictest0-21swapper/000:16:090
2636099197,2cyclictest0-21swapper/021:19:070
2636099192,4cyclictest0-21swapper/019:20:000
2636099190,7cyclictest0-21swapper/023:45:020
2636099190,2cyclictest16392-21ssh00:11:240
2636099190,2cyclictest0-21swapper/021:51:060
2636099190,18cyclictest0-21swapper/023:58:250
2636099190,17cyclictest0-21swapper/022:07:130
57972180,1sleep1221ktimersoftd/123:25:161
26363991811,5cyclictest17897-21runrttasks21:19:053
26362991815,2cyclictest7531-21kworker/u8:121:29:042
26362991815,2cyclictest32751-21kworker/u8:019:44:042
26362991815,2cyclictest16146-21kworker/u8:121:54:042
2636099189,2cyclictest0-21swapper/023:34:570
2636099189,2cyclictest0-21swapper/021:30:260
2636099188,2cyclictest0-21swapper/022:24:020
2636099185,3cyclictest15036-21sh23:35:140
2636099180,2cyclictest0-21swapper/022:51:250
2636099180,2cyclictest0-21swapper/021:45:030
2636099180,2cyclictest0-21swapper/000:21:030
2636099180,11cyclictest0-21swapper/022:16:040
274232170,0sleep30-21swapper/323:14:233
26363991714,2cyclictest381ktimersoftd/322:45:123
2636399171,3cyclictest24952-21diskstats20:25:163
26362991714,2cyclictest23479-21kworker/u8:022:23:042
26362991714,2cyclictest23479-21kworker/u8:022:10:042
26362991714,2cyclictest17738-21kworker/u8:200:19:042
26362991714,2cyclictest16175-21kworker/u8:122:34:042
2636299171,12cyclictest0-21swapper/222:26:042
2636299170,2cyclictest20311-21copy20:15:042
2636099179,2cyclictest0-21swapper/000:07:570
2636099177,2cyclictest0-21swapper/021:44:240
2636099174,3cyclictest2849-21rs:main0
2636099174,3cyclictest21435-21ps20:15:190
2636099174,3cyclictest20897-21sh23:41:040
2636099173,4cyclictest19632-21grep20:11:010
2636099173,3cyclictest0-21swapper/023:50:140
2636099170,5cyclictest18803-21ssh21:20:110
2636099170,2cyclictest13814-21ssh22:59:540
2636099170,2cyclictest13814-21ssh22:59:540
2636099170,2cyclictest0-21swapper/000:26:330
2636099170,16cyclictest0-21swapper/023:10:150
2636099170,10cyclictest0-21swapper/023:24:250
2636099170,10cyclictest0-21swapper/000:31:180
211962170,0sleep20-21swapper/223:06:452
186712170,2sleep00-21swapper/021:55:130
2636399161,12cyclictest0-21swapper/323:01:033
26362991613,2cyclictest7531-21kworker/u8:121:33:042
26362991613,2cyclictest7531-21kworker/u8:121:15:042
26362991613,2cyclictest3969-21kworker/u8:023:17:042
26362991613,2cyclictest27369-21kworker/u8:100:20:042
26362991613,2cyclictest18577-21kworker/u8:020:38:042
26362991613,2cyclictest17778-21kworker/u8:221:58:052
26362991613,2cyclictest16175-21kworker/u8:122:59:042
26362991613,2cyclictest16175-21kworker/u8:122:59:042
26362991613,2cyclictest16175-21kworker/u8:122:51:042
26362991613,2cyclictest16175-21kworker/u8:122:36:042
2636199161,13cyclictest14801-21grep00:10:151
26361991611,3cyclictest0-21swapper/123:07:081
2636199161,13cyclictest0-21swapper/119:45:131
2636099168,2cyclictest0-21swapper/020:07:370
2636099168,2cyclictest0-21swapper/019:45:150
2636099166,7cyclictest3688-21Xorg23:04:580
2636099164,3cyclictest14718-21cpuspeed_turbos20:00:140
2636099163,4cyclictest19062-21tr22:30:130
2636099163,3cyclictest29984-21cron20:40:000
2636099163,3cyclictest13832-21head19:56:030
2636099162,12cyclictest0-21swapper/021:10:000
2636099161,6cyclictest9284-21cron21:10:000
2636099161,3cyclictest0-21swapper/020:50:120
26360991610,5cyclictest0-21swapper/022:46:540
2636099160,15cyclictest0-21swapper/022:29:080
58252150,0sleep30-21swapper/319:36:033
26362991512,2cyclictest30710-21kworker/u8:119:46:042
26362991512,2cyclictest30710-21kworker/u8:119:28:042
26362991512,2cyclictest27460-21kworker/u8:200:25:042
26362991512,2cyclictest14355-21kworker/u8:323:35:042
26362991512,2cyclictest12440-21kworker/u8:220:09:042
26362991512,2cyclictest11249-21kworker/u8:219:11:042
26362991512,2cyclictest11249-21kworker/u8:219:11:042
2636299150,13cyclictest0-21swapper/221:10:102
2636199151,12cyclictest13140-21ssh21:48:351
26361991510,3cyclictest0-21swapper/122:01:321
2636099154,3cyclictest10668-21cpuspeed_turbos19:50:120
2636099154,3cyclictest0-21swapper/022:35:150
26360991510,3cyclictest4327-21ssh22:14:270
2636099150,1cyclictest0-21swapper/021:25:550
26363991411,2cyclictest9290-21diskmemload00:05:153
26363991411,2cyclictest3906-21kworker/u8:123:24:043
26363991411,2cyclictest31598-21kworker/u8:021:43:043
26363991411,2cyclictest2336-21kworker/u8:122:18:053
26363991411,2cyclictest22559-21kworker/u8:000:27:043
26363991411,2cyclictest17778-21kworker/u8:221:46:043
26363991411,2cyclictest17778-21kworker/u8:221:35:043
26363991411,2cyclictest17738-21kworker/u8:200:18:043
26363991411,2cyclictest16175-21kworker/u8:122:50:043
2636399140,2cyclictest32538-21apt-get23:55:053
2636399140,2cyclictest0-21swapper/322:25:163
2636399140,13cyclictest0-21swapper/322:05:153
2636399140,12cyclictest3728-21runrttasks00:39:453
2636399140,12cyclictest1215-21ssh22:10:193
26362991411,2cyclictest534-21kworker/u8:000:00:042
26362991411,2cyclictest31500-21kworker/u8:120:55:042
26362991411,2cyclictest30710-21kworker/u8:119:35:042
26362991411,2cyclictest30710-21kworker/u8:119:24:042
26362991411,2cyclictest27460-21kworker/u8:200:35:042
26362991411,2cyclictest25678-21kworker/u8:123:12:012
26362991411,2cyclictest18577-21kworker/u8:020:32:042
26362991411,2cyclictest18577-21kworker/u8:020:27:042
26362991411,2cyclictest17778-21kworker/u8:222:00:042
26362991411,2cyclictest12440-21kworker/u8:220:01:042
26362991411,2cyclictest11249-21kworker/u8:219:16:042
26362991411,2cyclictest0-21swapper/200:30:122
2636299140,2cyclictest0-21swapper/222:42:042
2636299140,13cyclictest0-21swapper/220:41:022
2636299140,12cyclictest0-21swapper/223:29:042
2636199142,6cyclictest0-21swapper/123:20:011
2636199142,6cyclictest0-21swapper/120:00:011
2636199141,2cyclictest18758-21munin-run23:40:011
26361991411,2cyclictest0-21swapper/121:26:011
26361991410,2cyclictest207150irq/24-eth122:25:121
26361991410,2cyclictest0-21swapper/123:10:431
26361991410,2cyclictest0-21swapper/100:30:271
2636199140,3cyclictest6927-21diskmemload00:36:101
2636199140,3cyclictest17974-21rm23:04:061
2636199140,2cyclictest0-21swapper/121:37:211
2636199140,2cyclictest0-21swapper/100:05:171
2636199140,12cyclictest7278-21ntp_states19:40:181
2636199140,12cyclictest24812-21ssh00:20:471
2636399132,6cyclictest0-21swapper/321:25:003
26363991310,2cyclictest31598-21kworker/u8:021:50:043
26363991310,2cyclictest23479-21kworker/u8:022:03:043
26363991310,2cyclictest17336-21kworker/u8:323:08:053
26363991310,2cyclictest0-21swapper/320:35:203
2636399130,3cyclictest0-21swapper/323:28:153
2636399130,2cyclictest0-21swapper/322:35:133
2636399130,2cyclictest0-21swapper/319:30:173
2636399130,11cyclictest0-21swapper/322:31:053
2636399130,11cyclictest0-21swapper/321:55:253
26362991310,2cyclictest9290-21diskmemload21:45:122
26362991310,2cyclictest534-21kworker/u8:000:12:042
26362991310,2cyclictest31598-21kworker/u8:021:41:042
26362991310,2cyclictest31598-21kworker/u8:021:39:042
26362991310,2cyclictest31257-21kworker/u8:223:30:012
26362991310,2cyclictest22401-21kworker/u8:322:48:042
26362991310,2cyclictest18577-21kworker/u8:020:47:042
26362991310,2cyclictest0-21swapper/223:41:122
2636299130,9cyclictest0-21swapper/221:24:042
2636299130,2cyclictest0-21swapper/222:17:312
2636299130,2cyclictest0-21swapper/219:30:112
2636299130,11cyclictest7496-21apt-get21:05:102
2636199139,2cyclictest0-21swapper/120:30:131
2636199138,3cyclictest0-21swapper/120:21:031
2636199132,6cyclictest9290-21diskmemload22:45:001
2636199132,6cyclictest20311-21copy20:15:021
2636199131,7cyclictest0-21swapper/121:50:001
2636199131,4cyclictest19346-21runrttasks20:10:171
26361991310,2cyclictest0-21swapper/123:31:111
26361991310,2cyclictest0-21swapper/123:15:591
26361991310,2cyclictest0-21swapper/122:40:201
26361991310,2cyclictest0-21swapper/122:20:501
26361991310,2cyclictest0-21swapper/122:11:411
26361991310,2cyclictest0-21swapper/121:10:411
26361991310,2cyclictest0-21swapper/120:46:041
26361991310,2cyclictest0-21swapper/100:00:011
2636199130,2cyclictest0-21swapper/123:47:041
2636199130,2cyclictest0-21swapper/122:56:471
2636199130,2cyclictest0-21swapper/122:56:461
2636199130,2cyclictest0-21swapper/120:50:111
2636199130,2cyclictest0-21swapper/119:16:021
2636199130,2cyclictest0-21swapper/100:17:531
2636199130,12cyclictest0-21swapper/123:41:231
2636199130,12cyclictest0-21swapper/122:35:331
2636199130,12cyclictest0-21swapper/122:17:261
2636199130,11cyclictest0-21swapper/119:21:201
315462120,2sleep30-21swapper/323:53:243
2636399129,2cyclictest7531-21kworker/u8:121:32:013
2636399129,2cyclictest534-21kworker/u8:000:02:013
2636399129,2cyclictest32751-21kworker/u8:019:41:043
2636399129,2cyclictest31500-21kworker/u8:120:44:043
2636399129,2cyclictest22559-21kworker/u8:000:33:043
2636399129,2cyclictest21270-21kworker/u8:023:47:043
2636399129,2cyclictest21270-21kworker/u8:023:42:043
2636399129,2cyclictest11249-21kworker/u8:219:18:043
2636399129,2cyclictest0-21swapper/320:50:163
2636399129,2cyclictest0-21swapper/320:10:113
2636399127,3cyclictest10737-21ssh21:10:243
2636399122,6cyclictest0-21swapper/320:01:043
2636399120,2cyclictest0-21swapper/322:41:023
2636399120,11cyclictest0-21swapper/321:05:043
2636399120,11cyclictest0-21swapper/321:00:183
2636399120,11cyclictest0-21swapper/320:20:183
2636399120,11cyclictest0-21swapper/319:26:023
2636299129,2cyclictest18577-21kworker/u8:020:50:012
2636299129,2cyclictest0-21swapper/223:54:322
2636299129,2cyclictest0-21swapper/223:02:062
2636299120,2cyclictest0-21swapper/200:06:322
2636299120,11cyclictest9290-21diskmemload22:06:022
2636299120,11cyclictest0-21swapper/223:56:092
2636299120,11cyclictest0-21swapper/223:23:442
2636299120,10cyclictest0-21swapper/219:57:042
2636199129,2cyclictest0-21swapper/122:51:131
2636199129,2cyclictest0-21swapper/121:20:301
2636199128,2cyclictest0-21swapper/119:50:151
2636199127,3cyclictest7493-21munin-node1
2636199127,3cyclictest29566-21munin-node1
2636199121,9cyclictest0-21swapper/119:35:161
2636199121,9cyclictest0-21swapper/119:25:181
2636199120,2cyclictest0-21swapper/121:30:231
2636199120,2cyclictest0-21swapper/120:05:301
2636199120,2cyclictest0-21swapper/119:55:181
2636199120,2cyclictest0-21swapper/119:31:011
2636199120,11cyclictest0-21swapper/123:55:201
2636199120,11cyclictest0-21swapper/122:05:201
2636099129,2cyclictest0-21swapper/023:05:130
2636099120,11cyclictest0-21swapper/019:20:180
141112120,1sleep10-21swapper/121:15:011
2636399118,2cyclictest30710-21kworker/u8:119:52:043
2636399118,2cyclictest23479-21kworker/u8:022:20:043
2636399118,2cyclictest17778-21kworker/u8:221:25:043
2636399118,2cyclictest0-21swapper/323:30:583
2636399118,2cyclictest0-21swapper/322:55:403
2636399118,2cyclictest0-21swapper/322:55:403
2636399116,3cyclictest26793-21wc20:30:153
2636399110,10cyclictest0-21swapper/300:21:013
2636299118,2cyclictest0-21swapper/221:00:292
2636299110,2cyclictest0-21swapper/220:11:042
2636199118,2cyclictest0-21swapper/120:25:131
2636199117,2cyclictest0-21swapper/120:35:141
2636199111,8cyclictest26570-21munin-node1
2636199111,8cyclictest26570-21munin-node1
2636199111,8cyclictest0-21swapper/120:55:151
2636199110,9cyclictest0-21swapper/120:40:121
2636099118,2cyclictest0-21swapper/019:40:150
2636099118,2cyclictest0-21swapper/019:26:030
2636099112,6cyclictest0-21swapper/019:10:010
2636099112,6cyclictest0-21swapper/019:10:010
2636099111,6cyclictest0-21swapper/020:56:390
2636099110,8cyclictest274-21jbd2/sda1-820:30:160
2636099110,2cyclictest9290-21diskmemload22:40:110
168082110,2sleep316820-21ssh23:36:493
153982110,2sleep30-21swapper/300:10:283
2636399108,1cyclictest0-21swapper/319:55:153
2636399107,2cyclictest3401-21kworker/u8:220:59:043
2636399107,2cyclictest30710-21kworker/u8:120:05:043
2636399107,2cyclictest18577-21kworker/u8:020:49:043
2636399107,2cyclictest0-21swapper/319:20:153
2636399105,3cyclictest29534-21sh23:15:513
2636399105,2cyclictest0-21swapper/320:15:183
2636399100,9cyclictest0-21swapper/319:10:153
2636399100,9cyclictest0-21swapper/319:10:153
2636099107,2cyclictest0-21swapper/019:35:370
2636099100,6cyclictest0-21swapper/020:41:360
263639994,3cyclictest9532-21mailstats19:46:003
263609994,3cyclictest32344-21df_abs20:45:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional