You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-19 - 05:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Thu Mar 19, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12834211995,19sleep00-21swapper/019:06:400
13051211496,12sleep20-21swapper/219:09:302
12470210681,6sleep10-21swapper/119:06:011
13069210386,11sleep30-21swapper/319:09:433
270942740,0sleep00-21swapper/021:40:170
265052720,0sleep10-21swapper/123:54:131
79182700,0sleep30-21swapper/322:27:293
1312199350,33cyclictest0-21swapper/022:15:090
311132260,1sleep10-21swapper/123:58:531
176522260,0sleep10-21swapper/122:37:331
1312399221,19cyclictest27351-21ssh23:55:122
1312399220,4cyclictest0-21swapper/222:45:122
294292210,1sleep10-21swapper/123:23:311
1312399211,3cyclictest18069-21ssh22:05:112
1312399210,19cyclictest0-21swapper/220:15:112
13121992116,3cyclictest0-21swapper/023:05:120
1312299200,2cyclictest0-21swapper/122:05:111
139372190,2sleep231-21ksoftirqd/223:06:572
1312199190,17cyclictest0-21swapper/023:55:120
13124991714,2cyclictest29198-21kworker/u8:221:52:013
1312399171,3cyclictest15051-21iostat_ios00:15:152
1312399171,14cyclictest25512-21apt-get23:20:052
13121991714,2cyclictest19232-21kworker/u8:222:14:010
13121991714,2cyclictest19232-21kworker/u8:222:14:000
85522161,3sleep18733-21wc21:21:031
56572160,0sleep20-21swapper/200:39:522
13124991613,2cyclictest17799-21kworker/u8:123:49:043
13124991612,2cyclictest16015-21kworker/u8:121:45:043
1312499161,13cyclictest0-21swapper/321:15:153
1312399161,3cyclictest0-21swapper/221:45:132
13123991611,3cyclictest0-21swapper/223:36:032
1312399161,13cyclictest0-21swapper/221:21:012
13121991613,2cyclictest6838-21kworker/u8:021:29:040
237502150,0sleep20-21swapper/223:50:332
13124991512,2cyclictest18586-21kworker/u8:223:24:043
1312399151,2cyclictest13290-21apt-get20:30:092
1312399151,12cyclictest11278-21apt-get20:25:112
1312399150,3cyclictest0-21swapper/220:00:152
1312399150,13cyclictest0-21swapper/222:38:152
1312299151,2cyclictest21960-21hddtemp_smartct21:35:131
1312299150,2cyclictest0-21swapper/123:31:021
1312299150,13cyclictest32699-21telnet22:20:141
1312199152,11cyclictest0-21swapper/023:20:480
13121991512,2cyclictest29198-21kworker/u8:221:50:040
13121991510,3cyclictest31993-21awk21:45:170
1312199150,3cyclictest0-21swapper/000:31:170
1312199150,13cyclictest0-21swapper/021:16:020
1312199150,13cyclictest0-21swapper/000:00:150
67982140,2sleep00-21swapper/000:06:160
13124991411,2cyclictest9906-21kworker/u8:122:40:043
13124991411,2cyclictest9906-21kworker/u8:122:31:043
13124991411,2cyclictest6920-21apt-get21:20:123
13124991411,2cyclictest4076-21kworker/u8:000:13:043
13124991411,2cyclictest4076-21kworker/u8:000:07:033
13124991411,2cyclictest17799-21kworker/u8:100:03:043
13124991411,2cyclictest15288-21kworker/u8:221:14:043
1312499140,2cyclictest0-21swapper/323:10:173
1312499140,2cyclictest0-21swapper/322:07:363
1312499140,12cyclictest1766-21cat22:21:033
1312499140,12cyclictest11957-21irqstats20:25:163
1312399149,3cyclictest0-21swapper/223:41:202
1312399142,6cyclictest0-21swapper/200:10:002
13123991411,2cyclictest0-21swapper/222:28:152
13123991410,2cyclictest1028-21ntp_states22:20:192
1312399140,2cyclictest0-21swapper/221:53:252
1312399140,13cyclictest23426-21ssh23:16:452
1312399140,13cyclictest0-21swapper/221:16:252
1312399140,12cyclictest0-21swapper/222:16:592
1312299140,12cyclictest0-21swapper/122:30:181
1312299140,12cyclictest0-21swapper/119:20:101
13121991411,2cyclictest0-21swapper/021:11:050
13121991411,2cyclictest0-21swapper/000:37:350
1312199141,11cyclictest13333-21apt-get19:10:090
1312199140,3cyclictest342-21ssh23:26:150
1312199140,2cyclictest26426-21ssh23:54:050
1312199140,13cyclictest0-21swapper/023:40:150
1312199140,13cyclictest0-21swapper/023:30:040
1312199140,12cyclictest29208-21diskmemload22:25:220
1312199140,12cyclictest21771-21ssh22:41:250
1312199140,12cyclictest14385-21apt-get22:35:070
1312199140,12cyclictest12617-21ssh21:59:370
1312199140,12cyclictest0-21swapper/023:02:010
1312199140,12cyclictest0-21swapper/022:07:250
293782131,8sleep30-21swapper/300:30:153
214442130,2sleep10-21swapper/100:21:351
200722130,3sleep30-21swapper/300:20:183
142722130,2sleep10-21swapper/123:07:291
13124991310,2cyclictest32502-21kworker/u8:223:05:043
13124991310,2cyclictest10925-21kworker/u8:219:16:043
13124991310,2cyclictest0-21swapper/323:30:143
13124991310,2cyclictest0-21swapper/322:51:033
13124991310,2cyclictest0-21swapper/321:42:363
13124991310,2cyclictest0-21swapper/300:35:463
1312499130,2cyclictest16726-21ssh22:36:073
1312499130,2cyclictest0-21swapper/323:50:593
1312499130,2cyclictest0-21swapper/321:32:273
1312499130,12cyclictest0-21swapper/323:56:033
1312499130,12cyclictest0-21swapper/322:15:593
1312499130,12cyclictest0-21swapper/321:36:153
1312499130,12cyclictest0-21swapper/319:30:163
1312399139,2cyclictest0-21swapper/223:30:122
1312399138,3cyclictest0-21swapper/221:42:092
1312399132,6cyclictest834-21copy20:00:002
13123991310,2cyclictest30432-21copy23:25:042
13123991310,2cyclictest0-21swapper/222:11:452
13123991310,2cyclictest0-21swapper/222:11:452
13123991310,2cyclictest0-21swapper/221:14:452
13123991310,2cyclictest0-21swapper/200:30:132
13123991310,2cyclictest0-21swapper/200:00:392
1312399130,3cyclictest0-21swapper/222:41:262
1312399130,12cyclictest0-21swapper/222:54:552
1312399130,12cyclictest0-21swapper/221:26:252
1312399130,11cyclictest17634-21ssh21:30:182
1312399130,11cyclictest13787-21ssh22:34:052
1312399130,11cyclictest0-21swapper/200:11:042
13122991310,2cyclictest0-21swapper/119:45:131
1312299130,2cyclictest0-21swapper/100:09:351
1312299130,11cyclictest0-21swapper/122:15:271
1312299130,11cyclictest0-21swapper/121:10:401
1312299130,11cyclictest0-21swapper/100:15:101
13121991310,2cyclictest2926-21ssh22:55:410
13121991310,2cyclictest0-21swapper/023:49:480
13121991310,2cyclictest0-21swapper/022:01:390
13121991310,2cyclictest0-21swapper/021:31:000
13121991310,2cyclictest0-21swapper/020:35:190
13121991310,2cyclictest0-21swapper/000:23:350
13121991310,2cyclictest0-21swapper/000:17:490
13121991310,2cyclictest0-21swapper/000:12:030
1312199130,8cyclictest0-21swapper/020:45:040
1312199130,2cyclictest0-21swapper/023:16:080
1312199130,2cyclictest0-21swapper/023:11:280
1312199130,2cyclictest0-21swapper/022:31:330
1312199130,2cyclictest0-21swapper/022:22:450
1312199130,2cyclictest0-21swapper/019:20:130
1312199130,12cyclictest0-21swapper/021:23:000
1312199130,12cyclictest0-21swapper/021:06:030
1312199130,11cyclictest29208-21diskmemload23:35:100
143242120,2sleep00-21swapper/020:30:370
1312499129,2cyclictest893-21latency_hist20:00:003
1312499129,2cyclictest23554-21kworker/u8:119:50:033
1312499129,2cyclictest21368-21kworker/u8:120:54:013
1312499129,2cyclictest13326-21kworker/u8:022:01:043
1312499129,2cyclictest10925-21kworker/u8:219:28:033
1312499129,2cyclictest0-21swapper/323:01:033
1312499129,2cyclictest0-21swapper/322:10:123
1312499129,2cyclictest0-21swapper/322:10:123
1312499129,2cyclictest0-21swapper/321:25:143
1312499129,2cyclictest0-21swapper/319:40:363
1312499121,9cyclictest3117-21chrt22:55:593
1312499120,2cyclictest0-21swapper/323:35:473
1312499120,2cyclictest0-21swapper/323:15:493
1312499120,2cyclictest0-21swapper/321:58:533
1312499120,2cyclictest0-21swapper/320:30:133
1312499120,2cyclictest0-21swapper/300:17:313
1312499120,11cyclictest0-21swapper/320:35:193
1312399129,2cyclictest0-21swapper/223:00:392
1312399129,2cyclictest0-21swapper/222:02:172
1312399129,2cyclictest0-21swapper/221:57:082
1312399129,2cyclictest0-21swapper/220:20:172
1312399129,2cyclictest0-21swapper/219:30:182
1312399127,3cyclictest3649-21snmpd19:50:342
1312399122,7cyclictest0-21swapper/221:05:012
1312399122,7cyclictest0-21swapper/221:01:592
1312399122,7cyclictest0-21swapper/220:40:022
1312399121,6cyclictest0-21swapper/219:50:002
1312399120,2cyclictest0-21swapper/223:10:542
1312399120,2cyclictest0-21swapper/221:35:122
1312399120,2cyclictest0-21swapper/200:25:302
1312399120,11cyclictest0-21swapper/223:45:142
1312399120,11cyclictest0-21swapper/222:55:122
1312399120,11cyclictest0-21swapper/220:55:152
1312399120,11cyclictest0-21swapper/220:10:172
1312399120,11cyclictest0-21swapper/219:10:112
1312399120,11cyclictest0-21swapper/200:21:382
1312299129,2cyclictest18586-21kworker/u8:223:40:011
1312299129,2cyclictest0-21swapper/123:10:501
1312299129,2cyclictest0-21swapper/121:45:121
1312299129,2cyclictest0-21swapper/120:55:181
1312299129,2cyclictest0-21swapper/120:40:261
1312299129,2cyclictest0-21swapper/119:30:381
1312299120,2cyclictest0-21swapper/122:26:361
1312299120,2cyclictest0-21swapper/122:04:081
1312299120,2cyclictest0-21swapper/121:50:321
1312299120,2cyclictest0-21swapper/121:00:391
1312299120,2cyclictest0-21swapper/120:00:141
1312299120,2cyclictest0-21swapper/119:50:191
1312299120,2cyclictest0-21swapper/100:35:171
1312299120,2cyclictest0-21swapper/100:31:091
1312299120,2cyclictest0-21swapper/100:11:141
1312299120,1cyclictest0-21swapper/122:55:141
1312299120,11cyclictest0-21swapper/122:13:231
1312299120,11cyclictest0-21swapper/122:13:231
1312299120,11cyclictest0-21swapper/121:27:171
1312299120,11cyclictest0-21swapper/119:40:281
1312299120,11cyclictest0-21swapper/119:36:031
1312299120,11cyclictest0-21swapper/119:15:141
1312299120,11cyclictest0-21swapper/119:10:091
1312299120,10cyclictest25022-21cut00:25:181
1312299120,10cyclictest0-21swapper/121:18:061
1312199129,2cyclictest23554-21kworker/u8:120:21:040
1312199129,2cyclictest10925-21kworker/u8:219:17:040
1312199129,2cyclictest0-21swapper/022:45:400
1312199129,2cyclictest0-21swapper/000:25:140
1312199122,6cyclictest0-21swapper/020:16:000
1312199120,11cyclictest0-21swapper/022:50:200
1312199120,11cyclictest0-21swapper/021:35:090
1312199120,11cyclictest0-21swapper/020:55:170
1312199120,11cyclictest0-21swapper/020:40:140
1312199120,11cyclictest0-21swapper/019:40:500
1312499118,2cyclictest9906-21kworker/u8:122:49:043
1312499118,2cyclictest23554-21kworker/u8:120:22:043
1312499118,2cyclictest23554-21kworker/u8:120:07:043
1312499118,2cyclictest18586-21kworker/u8:223:27:043
1312499118,2cyclictest15288-21kworker/u8:221:02:043
1312499118,2cyclictest1108-21kworker/u8:020:04:043
1312499110,10cyclictest16203-21ssh23:43:103
1312499110,10cyclictest0-21swapper/300:28:243
1312399118,2cyclictest0-21swapper/220:45:172
1312399112,8cyclictest0-21swapper/220:39:022
1312399112,7cyclictest0-21swapper/219:41:022
1312399112,6cyclictest0-21swapper/219:36:002
1312399111,6cyclictest0-21swapper/220:05:372
1312299118,2cyclictest20071-21ssh23:46:411
1312299118,2cyclictest0-21swapper/122:45:331
1312299118,2cyclictest0-21swapper/121:55:561
1312299118,2cyclictest0-21swapper/100:02:531
1312299110,9cyclictest0-21swapper/122:50:131
1312299110,2cyclictest0-21swapper/120:45:051
1312299110,10cyclictest0-21swapper/123:25:181
1312199118,2cyclictest0-21swapper/019:50:150
1312199118,2cyclictest0-21swapper/019:30:390
1312499107,2cyclictest23554-21kworker/u8:119:49:043
1312499107,2cyclictest18882-21kworker/u8:020:44:043
1312499107,2cyclictest10925-21kworker/u8:219:35:043
1312499107,2cyclictest0-21swapper/319:10:153
1312399107,2cyclictest0-21swapper/219:29:362
1312399107,2cyclictest0-21swapper/219:20:122
1312399107,2cyclictest0-21swapper/219:15:122
1312299107,2cyclictest29208-21diskmemload21:30:141
1312299107,2cyclictest29051-21kworker/u8:219:55:041
1312299107,2cyclictest207150irq/24-eth123:01:571
1312299107,2cyclictest0-21swapper/121:40:111
1312299105,3cyclictest9397-21sh23:35:431
1312299101,8cyclictest11275-21munin-node1
1312299100,9cyclictest0-21swapper/121:05:121
1312299100,9cyclictest0-21swapper/120:20:111
1312299100,9cyclictest0-21swapper/120:05:121
1312299100,8cyclictest0-21swapper/120:15:171
1312299100,2cyclictest5234-21apt-get20:10:111
1312299100,2cyclictest0-21swapper/123:18:361
1312299100,2cyclictest0-21swapper/120:50:131
1312199107,2cyclictest23554-21kworker/u8:120:10:040
1312199107,2cyclictest0-21swapper/020:06:010
1312199105,3cyclictest2306-21cat20:01:040
1312199105,3cyclictest12615-21wc20:26:020
1312199101,5cyclictest834-21copy20:00:000
1312199101,5cyclictest0-21swapper/019:50:000
1312199100,8cyclictest0-21swapper/019:25:130
131249996,2cyclictest0-21swapper/320:12:263
131249994,3cyclictest9036-21latency_hist20:19:593
131249994,3cyclictest3158-21dbus-daemon20:45:043
131249994,3cyclictest27988-21hddtemp_smartct21:05:153
131249994,3cyclictest18054-21kernelversion19:20:153
131249991,3cyclictest24330-21ps20:55:193
131239994,3cyclictest22916-21taskset20:51:532
131229996,2cyclictest207150irq/24-eth122:40:051
131229996,2cyclictest0-21swapper/120:30:081
131229996,2cyclictest0-21swapper/119:25:111
131229990,8cyclictest0-21swapper/120:35:121
131219983,3cyclictest24342-21processes19:35:170
131219983,3cyclictest0-21swapper/020:50:130
131219980,7cyclictest0-21swapper/021:00:550
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional