You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-20 - 10:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Wed May 20, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5942119114,3sleep00-21swapper/019:10:000
503211597,12sleep10-21swapper/119:08:521
504211395,12sleep20-21swapper/219:08:532
2290921040,0sleep30-21swapper/320:05:073
30529579,11sleep30-21swapper/319:06:183
41652840,0sleep10-21swapper/122:04:341
155222730,0sleep00-21swapper/022:50:150
192532720,0sleep00-21swapper/023:27:470
93412710,1sleep011-21rcuc/021:35:150
222832690,0sleep30-21swapper/322:22:443
624993516,2cyclictest31-21ksoftirqd/221:10:112
622992925,3cyclictest16961-21ssh21:10:120
207172290,0sleep10-21swapper/121:13:561
62499260,24cyclictest0-21swapper/221:15:142
62499260,24cyclictest0-21swapper/221:15:132
62499257,16cyclictest31-21ksoftirqd/221:40:122
251442240,0sleep20-21swapper/220:10:142
625992110,3cyclictest0-21swapper/322:01:423
62499211,18cyclictest0-21swapper/221:05:122
62399210,19cyclictest0-21swapper/122:55:101
62399210,19cyclictest0-21swapper/121:30:121
62499200,18cyclictest0-21swapper/200:20:142
62299200,2cyclictest0-21swapper/022:30:110
62499190,4cyclictest0-21swapper/222:59:042
62499180,13cyclictest0-21swapper/221:55:042
623991815,2cyclictest28686-21kworker/u8:223:50:041
59392180,0sleep30-21swapper/323:14:193
62599172,7cyclictest0-21swapper/322:56:023
625991712,3cyclictest0-21swapper/319:11:053
624991714,2cyclictest24109-21kworker/u8:122:33:042
624991714,2cyclictest14866-21kworker/u8:121:20:042
622991712,3cyclictest13178-21turbostat21:44:550
624991613,2cyclictest8856-21kworker/u8:223:18:042
624991613,2cyclictest31535-21kworker/u8:122:14:012
624991613,2cyclictest24515-21kworker/u8:223:00:042
624991613,2cyclictest20862-21kworker/u8:000:13:032
624991613,2cyclictest18407-21kworker/u8:120:03:042
624991613,2cyclictest14622-21kworker/u8:022:27:042
624991613,2cyclictest14622-21kworker/u8:022:24:042
624991611,3cyclictest0-21swapper/223:45:172
62499160,13cyclictest0-21swapper/223:54:252
62499160,11cyclictest0-21swapper/219:31:042
623991613,2cyclictest24515-21kworker/u8:223:01:041
623991611,3cyclictest0-21swapper/123:25:001
622991611,3cyclictest15957-21ssh23:58:560
62599152,7cyclictest0-21swapper/322:52:023
62599152,7cyclictest0-21swapper/322:45:003
62599152,4cyclictest0-21swapper/320:50:003
625991511,2cyclictest0-21swapper/320:30:153
625991510,3cyclictest0-21swapper/321:11:033
62599150,13cyclictest0-21swapper/323:29:593
62599150,12cyclictest0-21swapper/323:10:003
624991512,2cyclictest9137-21kworker/u8:019:53:042
624991512,2cyclictest6953-21kworker/u8:022:42:052
624991512,2cyclictest24109-21kworker/u8:123:07:042
624991512,2cyclictest12801-21kworker/u8:222:53:042
62499151,12cyclictest21562-21ssh23:30:152
62499150,3cyclictest12692-21latency_hist21:00:002
62499150,13cyclictest27706-21ssh23:36:122
623991510,3cyclictest25886-21kworker/u8:100:17:041
62399150,2cyclictest0-21swapper/100:03:291
269182150,2sleep10-21swapper/122:27:321
625991411,2cyclictest0-21swapper/320:00:163
62599140,12cyclictest16625-21diskmemload22:47:263
62499141,3cyclictest0-21swapper/221:51:392
624991411,2cyclictest544-21kworker/u8:220:48:012
624991411,2cyclictest3039-21kworker/u8:119:19:042
624991411,2cyclictest28580-21kworker/u8:120:42:042
624991411,2cyclictest24786-21kworker/u8:219:12:042
624991411,2cyclictest20862-21kworker/u8:000:15:042
624991411,2cyclictest20862-21kworker/u8:000:09:042
624991411,2cyclictest20862-21kworker/u8:000:09:042
624991411,2cyclictest0-21swapper/200:38:322
624991411,2cyclictest0-21swapper/200:33:432
62499140,9cyclictest0-21swapper/221:47:042
62499140,2cyclictest13705-21ssh23:55:522
62499140,2cyclictest0-21swapper/223:26:522
62499140,13cyclictest0-21swapper/222:35:322
62499140,13cyclictest0-21swapper/222:09:522
62499140,12cyclictest0-21swapper/223:20:182
62499140,12cyclictest0-21swapper/220:30:002
623991411,2cyclictest0-21swapper/122:15:151
623991410,3cyclictest9642-21open_files21:35:171
623991410,2cyclictest0-21swapper/121:25:171
62399140,12cyclictest5705-21latency_hist22:40:001
62399140,12cyclictest2613-21tail20:35:111
62399140,12cyclictest0-21swapper/121:19:491
62399140,12cyclictest0-21swapper/121:19:491
62399140,12cyclictest0-21swapper/100:33:011
62299142,7cyclictest22741-21copy20:05:000
62299142,7cyclictest0-21swapper/023:50:000
622991411,2cyclictest0-21swapper/023:05:150
622991411,2cyclictest0-21swapper/022:55:150
622991410,2cyclictest0-21swapper/019:40:280
62299140,3cyclictest0-21swapper/000:06:090
62299140,3cyclictest0-21swapper/000:06:090
62299140,2cyclictest0-21swapper/022:14:350
62299140,2cyclictest0-21swapper/021:22:150
62299140,12cyclictest10582-21latency_hist20:55:000
62599139,2cyclictest0-21swapper/323:00:453
62599138,3cyclictest31196-21memory23:40:163
62599132,6cyclictest0-21swapper/323:54:593
625991310,2cyclictest0-21swapper/300:28:163
625991310,2cyclictest0-21swapper/300:10:123
625991310,2cyclictest0-21swapper/300:08:063
625991310,2cyclictest0-21swapper/300:08:063
62599130,2cyclictest27582-21apt-get21:55:113
62599130,2cyclictest0-21swapper/319:50:153
62599130,11cyclictest0-21swapper/323:35:463
62599130,11cyclictest0-21swapper/322:25:143
62499138,3cyclictest0-21swapper/220:20:162
624991311,1cyclictest0-21swapper/223:40:422
624991311,1cyclictest0-21swapper/223:11:522
624991310,2cyclictest8614-21kworker/u8:022:04:032
624991310,2cyclictest28580-21kworker/u8:120:50:032
624991310,2cyclictest28580-21kworker/u8:120:35:042
624991310,2cyclictest24786-21kworker/u8:219:27:042
624991310,2cyclictest0-21swapper/222:16:252
624991310,2cyclictest0-21swapper/221:25:152
624991310,2cyclictest0-21swapper/221:01:022
624991310,2cyclictest0-21swapper/219:40:152
62499130,11cyclictest0-21swapper/221:30:142
62499130,11cyclictest0-21swapper/200:27:452
62499130,10cyclictest0-21swapper/222:46:592
623991310,2cyclictest7842-21ssh23:15:251
623991310,2cyclictest18998-21if_eth021:45:181
623991310,2cyclictest0-21swapper/122:13:051
623991310,2cyclictest0-21swapper/100:07:311
623991310,2cyclictest0-21swapper/100:07:311
62399130,2cyclictest0-21swapper/123:46:311
62399130,2cyclictest0-21swapper/123:25:181
62399130,2cyclictest0-21swapper/122:31:191
62399130,12cyclictest0-21swapper/123:57:371
62399130,12cyclictest0-21swapper/122:06:071
62399130,12cyclictest0-21swapper/121:52:271
62399130,12cyclictest0-21swapper/121:05:111
62399130,12cyclictest0-21swapper/100:12:001
62399130,11cyclictest0-21swapper/119:40:391
62299132,6cyclictest0-21swapper/022:25:000
62299132,6cyclictest0-21swapper/022:20:000
62299132,6cyclictest0-21swapper/019:55:000
62299132,6cyclictest0-21swapper/019:15:000
62299132,3cyclictest11662-21ntpq20:55:170
62299131,5cyclictest15999-21ssh23:25:000
622991310,2cyclictest0-21swapper/023:50:460
622991310,2cyclictest0-21swapper/022:08:070
622991310,2cyclictest0-21swapper/021:55:350
622991310,2cyclictest0-21swapper/021:45:050
622991310,2cyclictest0-21swapper/021:28:240
622991310,2cyclictest0-21swapper/020:21:000
622991310,2cyclictest0-21swapper/019:50:130
622991310,2cyclictest0-21swapper/000:33:360
622991310,2cyclictest0-21swapper/000:16:090
62299130,2cyclictest0-21swapper/000:35:560
62299130,2cyclictest0-21swapper/000:20:590
62299130,12cyclictest0-21swapper/023:12:550
62299130,12cyclictest0-21swapper/022:48:250
62299130,12cyclictest0-21swapper/022:02:050
62299130,12cyclictest0-21swapper/021:34:350
62299130,11cyclictest0-21swapper/023:32:400
62299130,11cyclictest0-21swapper/022:15:080
288182130,1sleep00-21swapper/023:38:020
277502130,2sleep10-21swapper/121:20:301
62599129,2cyclictest0-21swapper/323:45:153
62599129,2cyclictest0-21swapper/321:50:463
62599129,2cyclictest0-21swapper/321:05:173
62599129,2cyclictest0-21swapper/319:20:153
62599122,7cyclictest0-21swapper/323:30:023
62599122,7cyclictest0-21swapper/319:41:593
62599122,7cyclictest0-21swapper/319:36:593
62599122,6cyclictest0-21swapper/300:16:003
62599121,9cyclictest2866-21ssh21:29:083
62599121,7cyclictest0-21swapper/320:25:023
62599121,3cyclictest18494-21rm00:01:003
62599120,2cyclictest0-21swapper/322:05:263
62599120,2cyclictest0-21swapper/321:21:423
62599120,11cyclictest0-21swapper/321:40:263
62599120,10cyclictest16625-21diskmemload23:55:033
62599120,10cyclictest0-21swapper/320:24:553
62499129,2cyclictest20608-21kworker/u8:320:09:042
62499129,2cyclictest0-21swapper/221:35:042
62499129,2cyclictest0-21swapper/219:45:152
62499120,2cyclictest0-21swapper/200:00:442
62499120,11cyclictest0-21swapper/220:16:052
62399129,2cyclictest6069-21taskset19:20:271
62399129,2cyclictest0-21swapper/120:11:021
62399129,2cyclictest0-21swapper/119:50:571
62399129,2cyclictest0-21swapper/100:26:021
62399128,2cyclictest0-21swapper/120:45:131
62399127,3cyclictest207150irq/24-eth123:35:171
62399120,3cyclictest0-21swapper/119:55:181
62399120,2cyclictest0-21swapper/123:30:391
62399120,2cyclictest0-21swapper/123:10:471
62399120,2cyclictest0-21swapper/122:50:271
62399120,2cyclictest0-21swapper/122:20:151
62399120,2cyclictest0-21swapper/121:56:581
62399120,2cyclictest0-21swapper/120:40:141
62399120,2cyclictest0-21swapper/120:25:131
62399120,2cyclictest0-21swapper/120:20:171
62399120,2cyclictest0-21swapper/119:45:501
62399120,11cyclictest16625-21diskmemload00:21:151
62399120,11cyclictest0-21swapper/123:41:071
62399120,11cyclictest0-21swapper/123:07:121
62399120,11cyclictest0-21swapper/122:45:101
62399120,11cyclictest0-21swapper/122:40:171
62399120,11cyclictest0-21swapper/121:41:491
62399120,11cyclictest0-21swapper/120:55:171
62399120,11cyclictest0-21swapper/100:36:261
62299129,2cyclictest0-21swapper/022:42:360
62299129,2cyclictest0-21swapper/022:36:300
62299129,2cyclictest0-21swapper/021:05:120
62299129,2cyclictest0-21swapper/000:10:440
62299129,2cyclictest0-21swapper/000:00:150
62299122,6cyclictest0-21swapper/020:46:000
62299122,6cyclictest0-21swapper/020:35:000
62299122,5cyclictest0-21swapper/000:25:000
62299120,2cyclictest0-21swapper/023:41:300
62299120,2cyclictest0-21swapper/023:15:000
62299120,2cyclictest0-21swapper/021:52:170
62299120,11cyclictest0-21swapper/023:03:480
62299120,11cyclictest0-21swapper/021:15:230
62299120,11cyclictest0-21swapper/021:15:230
62599118,2cyclictest0-21swapper/321:31:263
62599118,2cyclictest0-21swapper/321:15:133
62599118,2cyclictest0-21swapper/321:15:133
62599118,2cyclictest0-21swapper/319:45:163
62599118,2cyclictest0-21swapper/319:30:113
62599111,7cyclictest0-21swapper/319:18:593
62599110,7cyclictest4562-21gdm-simple-gree00:36:593
62599110,2cyclictest11144-21ssh22:10:553
62599110,2cyclictest0-21swapper/320:15:143
62599110,10cyclictest0-21swapper/323:23:163
62599110,10cyclictest0-21swapper/322:32:023
62599110,10cyclictest0-21swapper/322:18:173
62599110,10cyclictest0-21swapper/321:45:363
62599110,10cyclictest0-21swapper/300:31:023
62599110,10cyclictest0-21swapper/300:22:373
62499118,2cyclictest0-21swapper/219:55:122
62499118,2cyclictest0-21swapper/219:35:142
62499110,10cyclictest0-21swapper/219:24:042
62399118,2cyclictest544-21kworker/u8:221:01:041
62399118,2cyclictest0-21swapper/120:30:371
62399112,5cyclictest0-21swapper/120:15:001
62399111,8cyclictest2864-21munin-node1
62399111,6cyclictest0-21swapper/120:50:001
62399110,9cyclictest21236-21df_abs20:00:131
62399110,9cyclictest1132-21expr19:10:161
62399110,9cyclictest0-21swapper/119:30:051
62299112,6cyclictest0-21swapper/019:46:590
62299112,6cyclictest0-21swapper/019:25:000
62299112,5cyclictest0-21swapper/020:11:020
62299112,3cyclictest3305-21cron20:20:000
62299111,6cyclictest0-21swapper/019:15:120
62599107,2cyclictest16625-21diskmemload22:36:573
62599107,2cyclictest0-21swapper/320:10:203
62599105,3cyclictest9202-21fschecks_count20:50:143
62599105,3cyclictest7439-21iostat_ios23:15:183
62599105,3cyclictest13380-21grep21:00:143
62599101,7cyclictest3728-21runrttasks20:43:203
62599101,6cyclictest0-21swapper/319:56:003
62599100,2cyclictest0-21swapper/321:36:163
62499105,3cyclictest0-21swapper/220:30:442
62399107,2cyclictest0-21swapper/119:25:151
62399100,8cyclictest0-21swapper/120:05:151
62399100,2cyclictest0-21swapper/119:35:301
62299102,7cyclictest0-21swapper/020:09:590
62299100,8cyclictest1316-1kworker/0:2H21:05:000
62299100,3cyclictest12259-21mailstats19:36:020
6259994,3cyclictest7432-21df_abs19:25:133
6259994,3cyclictest2609-21cut20:35:113
6229994,3cyclictest7780-21latency19:25:160
6229994,3cyclictest2713-21aten2.4_r3power20:35:110
6229991,6cyclictest0-21swapper/020:40:590
6259982,4cyclictest0-21swapper/320:55:113
6229984,3cyclictest30762-21apt-get20:25:010
6229983,3cyclictest9316-21wc19:30:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional