You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-01 - 06:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Sat Aug 01, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1627221130,1sleep30-21swapper/323:18:143
5453211295,12sleep10-21swapper/119:09:351
4749211193,13sleep20-21swapper/219:05:442
863721080,0sleep10-21swapper/119:15:391
4773210589,11sleep30-21swapper/319:05:573
5359210383,15sleep00-21swapper/019:08:220
308612710,0sleep00-21swapper/000:07:460
67202690,0sleep1221ktimersoftd/119:10:191
268282300,0sleep026829-21ssh23:29:300
5511992825,2cyclictest0-21swapper/019:10:110
99712270,0sleep20-21swapper/222:05:142
65972250,1sleep16598-21diskmemload22:35:121
551399221,19cyclictest0-21swapper/222:15:132
227182220,0sleep10-21swapper/122:51:031
551299211,2cyclictest0-21swapper/121:20:111
551399201,2cyclictest0-21swapper/220:30:112
551399200,18cyclictest0-21swapper/221:05:132
227312200,1sleep337-21rcuc/323:25:123
551499191,16cyclictest0-21swapper/319:35:123
551499190,2cyclictest0-21swapper/321:20:113
551299181,15cyclictest0-21swapper/121:59:451
126132180,0sleep20-21swapper/200:21:552
551299171,3cyclictest0-21swapper/122:17:251
26232170,0sleep00-21swapper/023:37:110
551299161,3cyclictest0-21swapper/121:46:361
551299160,3cyclictest0-21swapper/123:03:251
551299160,14cyclictest30967-21ssh00:07:551
551299160,14cyclictest207150irq/24-eth122:23:251
5511991613,2cyclictest6325-21kworker/u8:100:25:040
551499152,10cyclictest0-21swapper/322:33:593
551499150,13cyclictest7449-21kworker/u8:023:50:043
551499150,13cyclictest29435-21sshd22:58:333
551399151,3cyclictest0-21swapper/221:23:192
551399150,13cyclictest0-21swapper/223:58:042
551399150,13cyclictest0-21swapper/221:50:172
5512991512,2cyclictest28597-21kworker/u8:221:37:041
5512991512,2cyclictest21686-21kworker/u8:123:40:011
5512991512,2cyclictest0-21swapper/119:40:151
551299151,12cyclictest31913-21df20:15:131
551299151,12cyclictest31913-21df20:15:131
5512991510,3cyclictest25484-21ssh21:15:131
551299150,11cyclictest0-21swapper/100:21:041
551199151,3cyclictest0-21swapper/023:13:120
5511991512,2cyclictest9035-21kworker/u8:222:48:050
5511991512,2cyclictest28597-21kworker/u8:221:34:050
5511991510,3cyclictest25794-21cat22:21:030
5511991510,3cyclictest0-21swapper/021:10:130
5511991510,3cyclictest0-21swapper/019:51:100
551199150,4cyclictest0-21swapper/000:31:040
551199150,3cyclictest18051-21ssh22:13:460
551199150,13cyclictest13061-21fschecks_count20:50:140
551499140,2cyclictest0-21swapper/321:05:133
551499140,2cyclictest0-21swapper/319:20:133
551499140,12cyclictest29097-21tr23:31:013
551499140,12cyclictest29097-21tr23:31:013
551499140,12cyclictest21166-21munin-node3
551499140,12cyclictest10528-21modprobe23:45:153
551499140,12cyclictest0-21swapper/321:30:113
551399149,3cyclictest0-21swapper/223:11:012
551399142,6cyclictest0-21swapper/221:40:002
551399142,6cyclictest0-21swapper/200:30:012
551399141,3cyclictest2377-21sh23:36:492
5513991411,2cyclictest27921-21ssh23:30:142
5513991411,2cyclictest27921-21ssh23:30:142
551399140,2cyclictest0-21swapper/223:05:132
551399140,12cyclictest20291-21diskmemload00:31:082
551399140,12cyclictest0-21swapper/222:50:132
551399140,12cyclictest0-21swapper/221:31:382
551399140,12cyclictest0-21swapper/219:30:152
551299144,7cyclictest4562-21gdm-simple-gree22:07:591
551299142,7cyclictest0-21swapper/123:25:011
551299142,6cyclictest0-21swapper/119:40:001
551299142,6cyclictest0-21swapper/119:30:001
5512991411,2cyclictest20291-21diskmemload00:39:151
5512991411,2cyclictest0-21swapper/122:33:051
5512991411,2cyclictest0-21swapper/121:27:251
5512991410,2cyclictest0-21swapper/123:11:261
551299140,2cyclictest0-21swapper/122:45:251
551299140,2cyclictest0-21swapper/120:35:151
551299140,13cyclictest0-21swapper/121:51:151
551299140,13cyclictest0-21swapper/121:05:151
551299140,12cyclictest20291-21diskmemload23:21:451
551299140,12cyclictest0-21swapper/122:25:281
551299140,12cyclictest0-21swapper/122:10:061
551299140,12cyclictest0-21swapper/100:30:501
5511991411,2cyclictest32690-21kworker/u8:000:16:010
5511991411,2cyclictest21686-21kworker/u8:123:40:050
5511991411,2cyclictest12726-21kworker/u8:021:58:040
5511991410,2cyclictest0-21swapper/023:18:200
5511991410,2cyclictest0-21swapper/022:43:150
551199140,3cyclictest29663-21irqstats22:25:150
551199140,2cyclictest28293-21latency23:30:160
551199140,2cyclictest28293-21latency23:30:160
551199140,12cyclictest3649-21snmpd19:55:260
551199140,12cyclictest0-21swapper/019:45:170
551199140,12cyclictest0-21swapper/000:23:570
5514991310,2cyclictest0-21swapper/323:00:153
5514991310,2cyclictest0-21swapper/322:36:433
5514991310,2cyclictest0-21swapper/322:25:143
5514991310,2cyclictest0-21swapper/321:53:383
5514991310,2cyclictest0-21swapper/321:37:413
5514991310,2cyclictest0-21swapper/300:35:393
5514991310,2cyclictest0-21swapper/300:33:103
5514991310,2cyclictest0-21swapper/300:20:193
551499130,2cyclictest0-21swapper/321:43:123
551499130,2cyclictest0-21swapper/319:45:073
551499130,12cyclictest0-21swapper/320:20:083
551499130,12cyclictest0-21swapper/320:15:133
551499130,12cyclictest0-21swapper/320:15:133
551499130,11cyclictest0-21swapper/323:55:523
551399139,2cyclictest0-21swapper/223:00:122
551399139,2cyclictest0-21swapper/222:25:112
551399132,7cyclictest0-21swapper/220:50:372
551399131,2cyclictest20291-21diskmemload22:56:522
551399131,10cyclictest0-21swapper/221:55:122
5513991310,2cyclictest0-21swapper/223:21:042
5513991310,2cyclictest0-21swapper/222:11:442
5513991310,2cyclictest0-21swapper/221:47:532
5513991310,2cyclictest0-21swapper/221:40:442
5513991310,2cyclictest0-21swapper/221:16:132
5513991310,2cyclictest0-21swapper/200:35:542
551399130,2cyclictest0-21swapper/221:11:332
551399130,2cyclictest0-21swapper/220:05:202
551399130,2cyclictest0-21swapper/200:12:542
551399130,2cyclictest0-21swapper/200:05:152
551399130,12cyclictest0-21swapper/223:50:522
551399130,12cyclictest0-21swapper/200:16:012
551399130,12cyclictest0-21swapper/200:02:282
551299138,3cyclictest0-21swapper/100:10:101
551299131,3cyclictest0-21swapper/120:40:181
551299131,2cyclictest207150irq/24-eth100:00:211
551299131,10cyclictest0-21swapper/122:40:111
5512991310,2cyclictest4120-21kworker/u8:220:45:041
5512991310,2cyclictest12726-21kworker/u8:020:52:041
5512991310,2cyclictest1148-21kworker/u8:120:22:041
5512991310,2cyclictest0-21swapper/123:15:551
5512991310,2cyclictest0-21swapper/123:05:161
551299130,2cyclictest0-21swapper/121:33:361
551299130,12cyclictest0-21swapper/123:30:251
551299130,12cyclictest0-21swapper/123:30:251
551299130,12cyclictest0-21swapper/121:41:051
551299130,11cyclictest20291-21diskmemload23:36:211
551199139,2cyclictest7866-21sendmail-mta22:03:040
551199132,6cyclictest0-21swapper/020:20:000
5511991310,2cyclictest25927-21ssh22:55:120
5511991310,2cyclictest25750-21kworker/u8:321:48:040
5511991310,2cyclictest15052-21kworker/u8:123:02:030
5511991310,2cyclictest0-21swapper/021:39:010
551199130,2cyclictest3936-21ssh22:31:530
551199130,2cyclictest3835-21ssh21:25:180
551199130,2cyclictest28477-21ps20:05:210
551199130,2cyclictest25420-21ssh00:35:160
551199130,12cyclictest0-21swapper/022:53:060
551199130,12cyclictest0-21swapper/021:40:560
551199130,12cyclictest0-21swapper/019:40:180
551199130,11cyclictest0-21swapper/023:45:110
214932130,2sleep020291-21diskmemload22:16:360
122582130,2sleep020291-21diskmemload22:07:220
551499129,2cyclictest0-21swapper/323:42:573
551499129,2cyclictest0-21swapper/322:42:493
551499129,2cyclictest0-21swapper/322:08:273
551499129,2cyclictest0-21swapper/321:26:583
551499129,2cyclictest0-21swapper/320:55:183
551499129,2cyclictest0-21swapper/300:13:193
551499128,3cyclictest7486-21ssh22:02:283
551499122,7cyclictest0-21swapper/320:54:023
551499122,7cyclictest0-21swapper/320:26:593
551499122,7cyclictest0-21swapper/320:07:583
551499122,7cyclictest0-21swapper/320:03:023
551499122,7cyclictest0-21swapper/319:50:013
551499122,7cyclictest0-21swapper/319:43:593
551499120,3cyclictest21167-21ssh23:23:163
551499120,2cyclictest20291-21diskmemload22:20:513
551499120,2cyclictest20291-21diskmemload21:15:103
551499120,2cyclictest0-21swapper/323:05:293
551499120,2cyclictest0-21swapper/321:56:223
551499120,2cyclictest0-21swapper/321:10:133
551499120,11cyclictest21686-21kworker/u8:123:37:043
551499120,11cyclictest17576-21ssh22:45:513
551499120,11cyclictest0-21swapper/322:53:393
551499120,11cyclictest0-21swapper/322:13:323
551499120,11cyclictest0-21swapper/321:45:523
551499120,11cyclictest0-21swapper/320:35:013
551499120,11cyclictest0-21swapper/319:25:183
551499120,11cyclictest0-21swapper/319:10:293
551399129,2cyclictest0-21swapper/223:45:142
551399129,2cyclictest0-21swapper/222:00:382
551399129,2cyclictest0-21swapper/221:26:272
551399129,2cyclictest0-21swapper/220:40:172
551399129,2cyclictest0-21swapper/219:45:022
551399122,7cyclictest0-21swapper/219:28:592
551399122,6cyclictest25695-21ssh22:21:002
551399120,2cyclictest11150-21ssh22:40:012
551399120,2cyclictest0-21swapper/223:28:222
551399120,2cyclictest0-21swapper/222:45:022
551399120,2cyclictest0-21swapper/220:25:512
551399120,11cyclictest0-21swapper/223:40:342
551399120,11cyclictest0-21swapper/223:15:162
551399120,11cyclictest0-21swapper/222:36:042
551399120,11cyclictest0-21swapper/222:33:432
551399120,11cyclictest0-21swapper/220:16:022
551399120,11cyclictest0-21swapper/220:16:022
551399120,11cyclictest0-21swapper/219:55:152
551299129,2cyclictest21159-21kworker/u8:200:15:041
551299129,2cyclictest13567-21kworker/u8:120:02:041
551299129,2cyclictest0-21swapper/123:50:021
551299128,2cyclictest0-21swapper/120:30:121
551299121,9cyclictest0-21swapper/120:10:181
551299121,9cyclictest0-21swapper/100:25:161
551299121,3cyclictest0-21swapper/119:25:131
551299120,2cyclictest0-21swapper/122:56:591
551299120,2cyclictest0-21swapper/119:45:511
551299120,11cyclictest9841-21apt-get23:45:111
551299120,11cyclictest0-21swapper/123:56:461
551299120,11cyclictest0-21swapper/122:01:261
551299120,11cyclictest0-21swapper/121:10:311
551299120,10cyclictest0-21swapper/120:25:131
551299120,10cyclictest0-21swapper/119:20:141
551199129,2cyclictest32690-21kworker/u8:000:11:040
551199129,2cyclictest21159-21kworker/u8:223:56:040
551199129,2cyclictest0-21swapper/023:50:020
551199129,2cyclictest0-21swapper/022:35:240
551199129,2cyclictest0-21swapper/021:53:090
551199129,2cyclictest0-21swapper/000:01:270
551199121,6cyclictest0-21swapper/020:55:010
551199120,1cyclictest0-21swapper/023:23:200
551199120,1cyclictest0-21swapper/019:25:160
551199120,11cyclictest0-21swapper/021:23:230
551199120,11cyclictest0-21swapper/021:15:510
551199120,11cyclictest0-21swapper/019:36:020
52092120,2sleep30-21swapper/300:15:113
86172111,6sleep30-21swapper/320:40:123
551499118,2cyclictest0-21swapper/320:11:103
551499113,2cyclictest0-21swapper/323:10:043
551499112,7cyclictest0-21swapper/319:16:583
551499112,6cyclictest0-21swapper/321:01:023
551499112,6cyclictest0-21swapper/300:25:023
551499110,5cyclictest29141-21ssh00:05:043
551399118,2cyclictest0-21swapper/220:10:182
551399118,2cyclictest0-21swapper/219:10:132
551399111,6cyclictest0-21swapper/221:00:392
551399111,6cyclictest0-21swapper/221:00:012
551299111,8cyclictest0-21swapper/119:50:171
551299111,3cyclictest0-21swapper/120:05:151
551299110,9cyclictest14635-21munin-node1
551199111,5cyclictest0-21swapper/020:05:000
551199110,6cyclictest0-21swapper/020:50:010
551199110,1cyclictest0-21swapper/023:05:390
551499105,3cyclictest24824-21fschecks_count00:00:143
551499102,7cyclictest0-21swapper/319:32:013
551499102,6cyclictest0-21swapper/319:56:003
551499100,9cyclictest4120-21kworker/u8:220:34:013
551399107,2cyclictest0-21swapper/219:36:032
551399105,3cyclictest9712-21grep19:20:142
551399101,6cyclictest0-21swapper/220:20:072
551399101,6cyclictest0-21swapper/219:40:102
551399100,9cyclictest0-21swapper/220:03:212
551299101,7cyclictest240632sleep119:55:141
551299100,8cyclictest0-21swapper/121:00:121
551199107,2cyclictest0-21swapper/021:00:500
551199105,3cyclictest32182-21if_eth020:15:150
551199105,3cyclictest32182-21if_eth020:15:150
551199101,6cyclictest0-21swapper/019:31:000
551199101,5cyclictest19260-21kworker/0:320:45:010
55149994,3cyclictest11749-21sendmail_mailtr20:46:023
55139994,3cyclictest8130-21fschecks_time19:15:142
55139994,3cyclictest21830-21cpuspeed_turbos19:50:182
55139991,4cyclictest0-21swapper/220:35:122
55119994,3cyclictest9678-21cpuspeed_turbos19:20:140
55119994,3cyclictest3728-21runrttasks20:38:350
55119994,3cyclictest3127-21nscd19:15:120
55119994,3cyclictest18780-21cpuspeed_turbos21:05:140
55119993,4cyclictest3898-21fgrep20:26:020
55119991,6cyclictest30641-21sendmail_mailqu20:11:070
55139983,3cyclictest11763-21tr20:46:022
55119983,3cyclictest4773-21aten2.4-expect20:30:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional