You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-20 - 07:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sat Jun 20, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
130732116105,6sleep00-21swapper/019:06:230
13049211494,15sleep10-21swapper/119:06:041
2776721070,1sleep327766-21ssh21:41:563
13307210487,12sleep20-21swapper/219:09:262
1263529979,15sleep30-21swapper/319:05:503
219912720,1sleep3381ktimersoftd/319:30:133
251102690,0sleep00-21swapper/022:15:030
177922690,0sleep20-21swapper/223:51:252
305762680,1sleep30-21swapper/323:30:183
320042310,1sleep10-21swapper/123:32:011
1338299310,2cyclictest0-21swapper/223:40:122
14302290,0sleep01432-21ssh22:59:570
1338299232,16cyclictest0-21swapper/222:36:042
1337999210,19cyclictest0-21swapper/020:40:100
1338299202,13cyclictest0-21swapper/222:26:042
1338299201,14cyclictest0-21swapper/200:35:052
63592190,0sleep20-21swapper/221:54:382
13382991916,2cyclictest1409-21kworker/u8:220:23:052
13382991916,2cyclictest12-21rcu_preempt23:35:112
231372180,0sleep00-21swapper/022:12:030
218452180,0sleep00-21swapper/021:35:280
218452180,0sleep00-21swapper/021:35:280
1338299182,2cyclictest0-21swapper/221:44:052
13382991815,2cyclictest9124-21kworker/u8:021:27:052
13382991815,2cyclictest6766-21kworker/u8:123:06:052
13382991815,2cyclictest25978-21kworker/u8:219:12:032
13382991815,2cyclictest1409-21kworker/u8:221:05:052
13382991815,2cyclictest1409-21kworker/u8:220:48:042
13382991815,2cyclictest1409-21kworker/u8:220:14:042
13382991815,2cyclictest13691-21kworker/u8:019:28:032
1338299180,13cyclictest0-21swapper/200:27:052
13380991815,2cyclictest1409-21kworker/u8:220:59:051
175532170,0sleep20-21swapper/222:05:402
1338299172,7cyclictest0-21swapper/222:13:052
1338299172,2cyclictest0-21swapper/200:02:052
1338299172,14cyclictest0-21swapper/221:13:042
13382991714,2cyclictest9996-21kworker/u8:123:57:052
13382991714,2cyclictest9559-21kworker/u8:120:27:042
13382991714,2cyclictest25042-21kworker/u8:023:23:052
1338299170,9cyclictest0-21swapper/200:09:052
1338299170,2cyclictest0-21swapper/221:17:042
1338299170,2cyclictest0-21swapper/220:17:042
1338099172,13cyclictest24847-21sensors_fan19:35:591
1338099171,3cyclictest29518-21diskmemload22:40:001
1338299162,2cyclictest0-21swapper/223:47:052
13382991613,2cyclictest8496-21kworker/u8:222:41:052
13382991613,2cyclictest29723-21kworker/u8:019:50:032
13382991613,2cyclictest26846-21kworker/u8:200:15:042
1338299160,3cyclictest0-21swapper/223:04:012
1338299160,15cyclictest0-21swapper/220:57:042
1338099161,13cyclictest20759-21apt-get22:10:121
1338099161,13cyclictest11907-21sed20:25:131
1337999162,9cyclictest19707-21ssh00:30:010
13379991611,3cyclictest7187-21grep21:55:130
13383991512,2cyclictest0-21swapper/321:47:073
1338399150,13cyclictest0-21swapper/322:27:283
1338399150,13cyclictest0-21swapper/321:15:193
1338299151,2cyclictest0-21swapper/219:20:042
1338299150,3cyclictest31127-21ssh21:45:252
1338299150,2cyclictest0-21swapper/222:46:062
1338299150,2cyclictest0-21swapper/221:24:052
1338299150,2cyclictest0-21swapper/219:43:042
1338299150,13cyclictest29518-21diskmemload23:11:552
1338299150,13cyclictest0-21swapper/222:56:452
13380991512,2cyclictest26846-21kworker/u8:200:25:051
13380991512,2cyclictest18211-21kworker/u8:100:33:041
13380991511,2cyclictest24611-21apt-get00:35:111
1338099150,3cyclictest0-21swapper/123:22:591
1338099150,13cyclictest0-21swapper/122:41:001
1338099150,13cyclictest0-21swapper/100:10:071
1337999151,3cyclictest12368-21sed22:00:160
1337999151,12cyclictest29639-21apt-get21:45:060
13379991511,2cyclictest21031-21grep00:30:170
234442140,3sleep30-21swapper/323:22:503
13383991411,2cyclictest0-21swapper/322:35:103
13383991411,2cyclictest0-21swapper/321:10:183
13383991410,2cyclictest24081-21df_inode19:35:113
1338399140,13cyclictest0-21swapper/322:47:483
1338399140,13cyclictest0-21swapper/320:05:183
1338399140,12cyclictest2980-21expr21:50:173
1338399140,12cyclictest29677-21ssh22:20:033
1338399140,12cyclictest0-21swapper/323:15:593
1338399140,12cyclictest0-21swapper/321:55:123
13382991411,2cyclictest0-21swapper/223:32:352
13382991411,2cyclictest0-21swapper/223:25:142
13382991411,2cyclictest0-21swapper/200:12:262
1338299140,2cyclictest0-21swapper/222:32:062
1338299140,2cyclictest0-21swapper/221:55:052
1338299140,2cyclictest0-21swapper/221:03:042
1338299140,2cyclictest0-21swapper/220:43:042
1338299140,2cyclictest0-21swapper/220:08:042
1338299140,12cyclictest32208-21grep19:55:142
1338099141,11cyclictest0-21swapper/119:30:291
1338099140,3cyclictest12140-21ntpq23:10:161
1338099140,13cyclictest0-21swapper/123:01:001
1338099140,13cyclictest0-21swapper/121:15:391
1338099140,12cyclictest4331-21taskset22:26:461
1337999142,7cyclictest0-21swapper/023:25:000
1337999142,6cyclictest0-21swapper/021:05:000
13379991411,2cyclictest0-21swapper/023:09:070
13379991411,2cyclictest0-21swapper/022:05:380
13379991411,2cyclictest0-21swapper/000:01:380
1337999140,13cyclictest0-21swapper/020:45:170
13383991310,2cyclictest26800-21ssh00:36:323
13383991310,2cyclictest0-21swapper/323:10:483
13383991310,2cyclictest0-21swapper/322:51:593
13383991310,2cyclictest0-21swapper/322:42:433
13383991310,2cyclictest0-21swapper/322:00:293
13383991310,2cyclictest0-21swapper/321:36:413
13383991310,2cyclictest0-21swapper/321:36:413
13383991310,2cyclictest0-21swapper/321:04:593
13383991310,2cyclictest0-21swapper/319:50:183
13383991310,2cyclictest0-21swapper/300:27:573
13383991310,2cyclictest0-21swapper/300:23:243
13383991310,2cyclictest0-21swapper/300:16:133
13383991310,2cyclictest0-21swapper/300:05:433
1338399130,2cyclictest0-21swapper/323:51:573
1338399130,2cyclictest0-21swapper/322:30:153
1338399130,2cyclictest0-21swapper/321:31:543
1338399130,2cyclictest0-21swapper/319:55:123
1338399130,2cyclictest0-21swapper/300:32:553
1338399130,12cyclictest0-21swapper/322:17:153
1338399130,12cyclictest0-21swapper/321:25:573
1338399130,11cyclictest29518-21diskmemload21:20:403
1338399130,11cyclictest0-21swapper/323:45:223
13382991310,2cyclictest29518-21diskmemload22:51:282
13382991310,2cyclictest0-21swapper/221:30:152
1338299130,2cyclictest0-21swapper/222:21:062
1338299130,2cyclictest0-21swapper/220:34:042
1338299130,2cyclictest0-21swapper/219:38:012
1338299130,2cyclictest0-21swapper/200:32:242
1338299130,12cyclictest0-21swapper/222:15:152
1338299130,11cyclictest29518-21diskmemload00:20:242
1338099136,6cyclictest207150irq/24-eth123:45:051
1338099131,3cyclictest31744-21munin-node1
13380991310,2cyclictest21294-21hddtemp_smartct21:35:141
13380991310,2cyclictest21294-21hddtemp_smartct21:35:131
13380991310,2cyclictest0-21swapper/123:35:221
13380991310,2cyclictest0-21swapper/122:08:491
1338099130,2cyclictest0-21swapper/123:40:391
1338099130,2cyclictest0-21swapper/123:05:491
1338099130,2cyclictest0-21swapper/122:55:061
1338099130,2cyclictest0-21swapper/122:30:121
1338099130,2cyclictest0-21swapper/121:55:161
1338099130,2cyclictest0-21swapper/121:50:111
1338099130,2cyclictest0-21swapper/121:32:501
1338099130,2cyclictest0-21swapper/119:10:131
1338099130,2cyclictest0-21swapper/100:00:391
1338099130,12cyclictest0-21swapper/122:51:411
1338099130,12cyclictest0-21swapper/121:46:021
1338099130,12cyclictest0-21swapper/121:21:451
1338099130,12cyclictest0-21swapper/119:50:481
1338099130,12cyclictest0-21swapper/119:45:141
1337999138,3cyclictest0-21swapper/021:30:050
1337999132,6cyclictest3196-21copy20:05:000
1337999132,6cyclictest0-21swapper/021:30:010
1337999132,6cyclictest0-21swapper/020:55:000
1337999131,6cyclictest0-21swapper/020:25:000
13379991310,2cyclictest0-21swapper/023:48:280
13379991310,2cyclictest0-21swapper/022:22:280
1337999130,2cyclictest0-21swapper/023:56:580
1337999130,2cyclictest0-21swapper/000:06:270
1337999130,12cyclictest0-21swapper/023:01:280
1337999130,12cyclictest0-21swapper/000:35:080
231642120,2sleep20-21swapper/221:37:032
231642120,2sleep20-21swapper/221:37:022
1338399129,2cyclictest0-21swapper/323:55:213
1338399129,2cyclictest0-21swapper/322:55:333
1338399129,2cyclictest0-21swapper/320:25:133
1338399129,2cyclictest0-21swapper/320:20:143
1338399120,2cyclictest0-21swapper/323:05:493
1338399120,2cyclictest0-21swapper/319:10:093
1338399120,2cyclictest0-21swapper/300:00:383
1338399120,11cyclictest0-21swapper/323:40:163
1338399120,11cyclictest0-21swapper/323:35:463
1338399120,11cyclictest0-21swapper/323:26:303
1338399120,11cyclictest0-21swapper/323:02:433
1338399120,11cyclictest0-21swapper/320:56:043
1338399120,11cyclictest0-21swapper/320:36:003
1338399120,11cyclictest0-21swapper/300:10:123
1338399120,10cyclictest20316-21kworker/u8:122:10:043
1338299129,2cyclictest0-21swapper/223:18:242
1338299129,2cyclictest0-21swapper/219:45:132
1338299120,2cyclictest0-21swapper/219:15:052
1338299120,11cyclictest0-21swapper/222:00:302
1338099129,2cyclictest29518-21diskmemload22:23:201
1338099129,2cyclictest11241-21fschecks_time00:20:141
1338099129,2cyclictest0-21swapper/123:15:091
1338099129,2cyclictest0-21swapper/122:15:341
1338099129,2cyclictest0-21swapper/121:00:501
1338099129,2cyclictest0-21swapper/100:16:031
1338099121,9cyclictest27723-21munin-node1
1338099121,9cyclictest11593-21apt-get22:00:101
1338099121,3cyclictest17638-21packagekitd19:20:041
1338099121,3cyclictest0-21swapper/120:01:031
1338099121,3cyclictest0-21swapper/119:41:011
1338099120,2cyclictest29518-21diskmemload00:06:361
1338099120,2cyclictest0-21swapper/123:56:061
1338099120,2cyclictest0-21swapper/121:25:121
1338099120,2cyclictest0-21swapper/121:12:051
1338099120,11cyclictest0-21swapper/123:25:501
1338099120,11cyclictest0-21swapper/122:45:381
1338099120,11cyclictest0-21swapper/121:40:451
1338099120,11cyclictest0-21swapper/120:50:151
1338099120,11cyclictest0-21swapper/120:30:121
1338099120,11cyclictest0-21swapper/120:15:131
1337999129,2cyclictest29518-21diskmemload23:39:580
1337999129,2cyclictest0-21swapper/023:40:280
1337999129,2cyclictest0-21swapper/023:30:170
1337999129,2cyclictest0-21swapper/023:19:070
1337999129,2cyclictest0-21swapper/022:49:480
1337999129,2cyclictest0-21swapper/022:41:070
1337999129,2cyclictest0-21swapper/021:22:270
1337999129,2cyclictest0-21swapper/021:18:570
1337999129,2cyclictest0-21swapper/019:50:110
1337999122,6cyclictest0-21swapper/022:30:590
1337999121,3cyclictest2577-21ssh22:25:150
1337999120,3cyclictest0-21swapper/020:31:050
1337999120,2cyclictest0-21swapper/022:35:590
1337999120,2cyclictest0-21swapper/019:20:060
1337999120,2cyclictest0-21swapper/000:18:090
1337999120,11cyclictest29518-21diskmemload21:40:170
1337999120,11cyclictest0-21swapper/022:50:180
1337999120,11cyclictest0-21swapper/020:35:390
1337999120,11cyclictest0-21swapper/020:15:180
1337999120,10cyclictest29518-21diskmemload00:20:590
1337999120,10cyclictest0-21swapper/023:50:580
1337999120,10cyclictest0-21swapper/021:51:170
1338399118,2cyclictest0-21swapper/319:25:143
1338399111,2cyclictest17721-21ssh22:05:583
1338399110,10cyclictest13691-21kworker/u8:019:21:043
1338099118,2cyclictest29665-21kworker/u8:023:51:051
1338099118,2cyclictest0-21swapper/120:40:131
1338099118,2cyclictest0-21swapper/119:26:001
1338099118,2cyclictest0-21swapper/119:15:141
1338099116,3cyclictest0-21swapper/120:10:111
1338099110,3cyclictest0-21swapper/120:06:011
1338099110,10cyclictest0-21swapper/120:20:431
1337999118,2cyclictest0-21swapper/023:13:080
1337999118,2cyclictest0-21swapper/021:10:490
1337999111,8cyclictest0-21swapper/021:09:530
1337999110,2cyclictest0-21swapper/020:55:150
1337999110,10cyclictest0-21swapper/019:45:150
1337999110,10cyclictest0-21swapper/000:13:490
1338399107,2cyclictest0-21swapper/320:01:033
1338299100,2cyclictest0-21swapper/219:32:062
1338099106,2cyclictest0-21swapper/120:35:111
1338099100,9cyclictest0-21swapper/120:45:121
1337999105,3cyclictest22774-21find19:31:000
1337999104,4cyclictest16477-21tr19:15:170
1337999101,7cyclictest0-21swapper/020:30:000
1337999101,6cyclictest0-21swapper/019:10:460
1337999101,5cyclictest0-21swapper/020:00:110
1337999100,2cyclictest29518-21diskmemload23:25:540
1337999100,2cyclictest0-21swapper/019:40:160
133839996,2cyclictest0-21swapper/320:40:193
133839996,2cyclictest0-21swapper/320:10:113
133839996,2cyclictest0-21swapper/319:46:003
133829994,3cyclictest274-21jbd2/sda1-820:50:052
133829994,3cyclictest16629-21chrt20:35:312
133829990,8cyclictest0-21swapper/220:00:552
133799994,3cyclictest24478-21sort19:35:150
133799994,3cyclictest1079-21latency_hist20:00:000
133799991,3cyclictest0-21swapper/019:25:160
133839985,2cyclictest0-21swapper/321:08:553
133839985,2cyclictest0-21swapper/320:45:183
133839985,2cyclictest0-21swapper/320:30:123
133839984,2cyclictest25811-21aten2.4-expect19:40:133
133839983,3cyclictest8843-21timerandwakeup20:16:033
133839983,3cyclictest16190-21awk19:15:143
133839980,7cyclictest0-21swapper/320:53:233
133799983,3cyclictest5530-21chrt20:10:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional