You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-26 - 13:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Fri Jun 26, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
102412116105,6sleep30-21swapper/319:06:183
104202114103,6sleep10-21swapper/119:08:381
87342113102,6sleep20-21swapper/219:05:062
10454211289,18sleep00-21swapper/019:09:050
90202700,1sleep00-21swapper/022:35:160
281992690,0sleep10-21swapper/121:11:401
130042670,0sleep00-21swapper/023:50:120
10558993414,18cyclictest0-21swapper/321:20:123
1055699340,32cyclictest0-21swapper/121:05:121
291092310,0sleep20-21swapper/221:47:012
1055599231,3cyclictest0-21swapper/022:01:260
1055599230,3cyclictest25341-21ssh21:43:300
1055599230,3cyclictest0-21swapper/023:59:540
1055899221,19cyclictest0-21swapper/322:20:133
10557992218,3cyclictest5606-21kworker/u8:221:23:052
1055699221,19cyclictest0-21swapper/123:10:121
1055599220,3cyclictest26764-21munin-node0
1055599220,3cyclictest2616-21taskset22:28:590
1055599220,3cyclictest24118-21ssh22:16:140
1055599220,3cyclictest22097-21rm00:00:100
1055599220,3cyclictest16897-21ssh22:09:100
1055599220,3cyclictest1318-21rm23:01:390
1055599220,3cyclictest11404-21if_eth019:10:140
1055599220,3cyclictest0-21swapper/023:45:300
1055599220,3cyclictest0-21swapper/023:35:060
1055599220,3cyclictest0-21swapper/023:33:060
1055599220,3cyclictest0-21swapper/021:30:140
1055599220,3cyclictest0-21swapper/021:16:100
1055599220,3cyclictest0-21swapper/000:37:540
1055599220,3cyclictest0-21swapper/000:32:180
1055599220,3cyclictest0-21swapper/000:19:310
1055599220,3cyclictest0-21swapper/000:10:140
1055599220,2cyclictest0-21swapper/021:50:190
1055799211,2cyclictest25583-21diskmemload21:30:102
1055799210,19cyclictest0-21swapper/220:05:122
1055599210,3cyclictest9661-21ssh00:20:420
1055599210,3cyclictest25583-21diskmemload22:40:100
1055599210,3cyclictest18598-21ssh23:20:220
1055599210,3cyclictest12363-21sh23:14:340
1055599210,3cyclictest0-21swapper/022:55:140
1055599210,3cyclictest0-21swapper/022:54:020
1055599210,3cyclictest0-21swapper/020:30:180
1055599210,3cyclictest0-21swapper/020:05:060
1055599210,3cyclictest0-21swapper/019:21:020
1055599210,3cyclictest0-21swapper/000:25:140
1055599210,2cyclictest0-21swapper/023:18:220
1055599210,2cyclictest0-21swapper/021:23:100
1055599210,2cyclictest0-21swapper/019:50:100
1055799200,2cyclictest0-21swapper/221:00:112
1055599200,3cyclictest173042chrt20:47:350
1055599200,2cyclictest18946-21ssh22:45:500
1055599200,2cyclictest0-21swapper/023:40:420
1055599200,2cyclictest0-21swapper/023:25:150
1055599200,2cyclictest0-21swapper/023:08:500
1055599200,2cyclictest0-21swapper/022:34:580
1055599200,2cyclictest0-21swapper/022:11:260
1055599200,2cyclictest0-21swapper/021:56:030
1055599200,2cyclictest0-21swapper/021:46:020
1055599200,2cyclictest0-21swapper/021:36:270
1055599200,2cyclictest0-21swapper/021:25:340
1055599200,2cyclictest0-21swapper/021:10:270
1055599200,2cyclictest0-21swapper/020:40:140
1055599200,2cyclictest0-21swapper/020:00:100
1055599200,2cyclictest0-21swapper/019:16:020
1055599200,2cyclictest0-21swapper/000:09:060
10557991916,2cyclictest10519-21kworker/u8:119:23:042
10557991916,2cyclictest10519-21kworker/u8:119:17:052
10557991914,3cyclictest30983-21rm23:35:112
1055599190,2cyclictest22150irq/25-ahci[00021:00:060
1055599190,2cyclictest16815-21apt-get19:25:100
1055599190,2cyclictest0-21swapper/020:15:140
1055599190,2cyclictest0-21swapper/019:44:060
1055599190,2cyclictest0-21swapper/019:30:150
1055599190,1cyclictest0-21swapper/019:55:160
1055899181,3cyclictest0-21swapper/322:15:143
10557991815,2cyclictest9557-21kworker/u8:220:32:052
10557991815,2cyclictest8391-21kworker/u8:000:25:052
10557991815,2cyclictest17813-21kworker/u8:120:57:052
10557991815,2cyclictest1602-21kworker/u8:223:47:042
10557991815,2cyclictest1602-21kworker/u8:200:07:042
10557991815,2cyclictest13776-21kworker/u8:222:08:042
10557991815,2cyclictest12986-21kworker/u8:023:24:012
1055599180,2cyclictest8060-21apt-get20:25:100
1055599180,2cyclictest0-21swapper/021:05:140
1055599180,2cyclictest0-21swapper/020:51:020
1055599180,2cyclictest0-21swapper/020:24:590
1055599180,2cyclictest0-21swapper/020:10:100
1055599180,2cyclictest0-21swapper/019:45:140
1055599180,17cyclictest0-21swapper/019:35:140
63652170,0sleep10-21swapper/123:42:431
10558991712,3cyclictest0-21swapper/320:10:143
1055899170,15cyclictest21568-21sendmail21:40:003
10557991714,2cyclictest9557-21kworker/u8:220:36:052
10557991714,2cyclictest9533-21kworker/u8:222:49:052
10557991714,2cyclictest5606-21kworker/u8:221:27:042
10557991714,2cyclictest4278-21kworker/u8:120:24:042
10557991714,2cyclictest29263-21kworker/u8:000:14:042
10557991714,2cyclictest24898-21kworker/u8:019:46:042
10557991714,2cyclictest23785-21kworker/u8:022:02:052
10557991714,2cyclictest23785-21kworker/u8:021:18:042
10557991714,2cyclictest23785-21kworker/u8:021:10:042
10557991714,2cyclictest21271-21kworker/u8:022:40:012
10557991714,2cyclictest21271-21kworker/u8:022:22:042
10557991714,2cyclictest13776-21kworker/u8:222:18:042
10557991714,2cyclictest10519-21kworker/u8:119:35:042
10557991714,2cyclictest10519-21kworker/u8:119:26:042
10557991713,2cyclictest22591-21kworker/u8:220:10:042
1055599170,2cyclictest0-21swapper/020:55:260
1055599170,2cyclictest0-21swapper/020:35:020
1055899161,3cyclictest22620-21cut00:35:153
1055899161,13cyclictest17528-21munin-node3
10557991613,2cyclictest7609-21kworker/u8:223:14:052
10557991613,2cyclictest24149-21kworker/u8:223:27:042
10557991613,2cyclictest23785-21kworker/u8:021:44:042
10557991613,2cyclictest22591-21kworker/u8:219:56:052
10557991613,2cyclictest22591-21kworker/u8:219:54:012
10557991613,2cyclictest22591-21kworker/u8:219:41:052
10557991613,2cyclictest21271-21kworker/u8:022:34:042
10557991613,2cyclictest10519-21kworker/u8:119:10:042
1055699161,13cyclictest0-21swapper/119:15:151
1055899151,12cyclictest31293-21apt-get21:50:113
1055899151,12cyclictest17991-21hddtemp_smartct23:55:143
10558991510,3cyclictest3414-21latency_hist00:15:003
10558991510,3cyclictest13868-21ps22:40:173
1055899150,13cyclictest19564-21sort20:55:003
1055899150,13cyclictest18775-21ssh00:30:343
1055899150,13cyclictest11652-21ssh22:38:293
1055799155,7cyclictest0-21swapper/223:51:582
10557991512,2cyclictest9557-21kworker/u8:221:05:042
10557991512,2cyclictest9533-21kworker/u8:222:50:052
10557991512,2cyclictest1602-21kworker/u8:200:15:042
10557991512,2cyclictest10519-21kworker/u8:119:33:042
1055699151,3cyclictest21910-21munin-run22:50:001
1055699151,3cyclictest0-21swapper/121:25:451
1055699151,12cyclictest8306-21apt-get22:35:121
1055699151,12cyclictest31685-21df22:25:141
10556991510,3cyclictest208382chrt19:35:121
10556991510,3cyclictest13138-21users20:36:031
10556991510,3cyclictest0-21swapper/122:11:041
1055699150,13cyclictest0-21swapper/123:49:271
1055899143,6cyclictest17240-21ssh00:30:003
1055899140,2cyclictest0-21swapper/323:46:343
1055899140,2cyclictest0-21swapper/319:55:143
1055899140,2cyclictest0-21swapper/300:17:053
1055899140,13cyclictest0-21swapper/323:07:143
1055899140,13cyclictest0-21swapper/321:33:053
1055899140,12cyclictest0-21swapper/323:14:363
1055899140,12cyclictest0-21swapper/322:03:583
10557991411,2cyclictest22305-21kworker/u8:100:04:052
10557991411,2cyclictest21914-21kworker/u8:121:51:042
10557991411,2cyclictest1602-21kworker/u8:223:56:042
10557991411,2cyclictest11810-21kworker/u8:020:46:042
1055799140,12cyclictest31522-21smartctl20:00:142
1055699149,3cyclictest0-21swapper/100:21:461
1055699143,9cyclictest14018-21cut23:15:191
1055699142,6cyclictest0-21swapper/122:55:001
1055699142,6cyclictest0-21swapper/120:45:001
1055699141,9cyclictest25583-21diskmemload23:30:481
10556991410,2cyclictest0-21swapper/123:00:071
1055699140,12cyclictest25583-21diskmemload23:29:581
1055699140,12cyclictest0-21swapper/123:58:421
1055699140,12cyclictest0-21swapper/121:40:291
1055699140,12cyclictest0-21swapper/120:56:011
1055899139,2cyclictest20982-21ssh23:24:123
1055899131,7cyclictest0-21swapper/320:40:003
1055899131,6cyclictest0-21swapper/319:30:003
1055899131,6cyclictest0-21swapper/319:15:003
10558991310,2cyclictest0-21swapper/322:58:553
10558991310,2cyclictest0-21swapper/322:08:403
10558991310,2cyclictest0-21swapper/320:20:173
10558991310,2cyclictest0-21swapper/300:05:173
1055899130,2cyclictest0-21swapper/323:54:053
1055899130,2cyclictest0-21swapper/323:35:073
1055899130,2cyclictest0-21swapper/321:48:283
1055899130,2cyclictest0-21swapper/300:20:183
1055899130,12cyclictest0-21swapper/322:10:113
1055899130,12cyclictest0-21swapper/321:16:033
1055899130,12cyclictest0-21swapper/300:00:453
1055799130,11cyclictest25583-21diskmemload23:00:142
1055699133,8cyclictest0-21swapper/119:45:151
10556991310,2cyclictest0-21swapper/123:51:131
10556991310,2cyclictest0-21swapper/122:56:331
10556991310,2cyclictest0-21swapper/122:01:331
10556991310,2cyclictest0-21swapper/121:58:111
10556991310,2cyclictest0-21swapper/121:45:011
10556991310,2cyclictest0-21swapper/121:21:031
10556991310,2cyclictest0-21swapper/100:32:021
1055699130,2cyclictest0-21swapper/123:06:471
1055699130,2cyclictest0-21swapper/122:22:231
1055699130,2cyclictest0-21swapper/121:37:191
1055699130,2cyclictest0-21swapper/121:34:291
1055699130,2cyclictest0-21swapper/100:16:031
1055699130,2cyclictest0-21swapper/100:05:301
1055699130,12cyclictest0-21swapper/120:05:131
1055699130,11cyclictest25583-21diskmemload23:21:031
1055699130,11cyclictest25583-21diskmemload21:18:311
1055699130,11cyclictest0-21swapper/121:00:391
1055699130,11cyclictest0-21swapper/100:12:311
1055899129,2cyclictest0-21swapper/323:30:423
1055899129,2cyclictest0-21swapper/323:25:583
1055899129,2cyclictest0-21swapper/323:15:143
1055899129,2cyclictest0-21swapper/323:00:043
1055899129,2cyclictest0-21swapper/322:53:303
1055899129,2cyclictest0-21swapper/321:40:173
1055899129,2cyclictest0-21swapper/321:10:053
1055899129,2cyclictest0-21swapper/320:30:183
1055899129,2cyclictest0-21swapper/320:25:103
1055899129,2cyclictest0-21swapper/320:05:403
1055899129,2cyclictest0-21swapper/319:50:163
1055899120,11cyclictest0-21swapper/323:40:253
1055899120,11cyclictest0-21swapper/322:32:413
1055899120,11cyclictest0-21swapper/322:26:493
1055899120,11cyclictest0-21swapper/321:55:083
1055899120,11cyclictest0-21swapper/321:26:353
1055899120,11cyclictest0-21swapper/320:41:013
1055799129,2cyclictest9557-21kworker/u8:220:52:052
1055799129,2cyclictest25994-21kworker/u8:122:28:042
1055799122,7cyclictest0-21swapper/200:22:582
1055799120,2cyclictest0-21swapper/223:40:182
1055699129,2cyclictest0-21swapper/122:07:351
1055699129,2cyclictest0-21swapper/120:21:001
1055699121,9cyclictest32585-21sensors23:36:011
1055699121,9cyclictest0-21swapper/122:40:101
1055699121,9cyclictest0-21swapper/119:51:031
1055699121,9cyclictest0-21swapper/119:31:001
1055699121,9cyclictest0-21swapper/119:21:031
1055699120,2cyclictest0-21swapper/122:30:531
1055699120,2cyclictest0-21swapper/121:51:061
1055699120,2cyclictest0-21swapper/120:30:131
1055699120,2cyclictest0-21swapper/119:10:141
1055699120,2cyclictest0-21swapper/100:00:571
1055699120,11cyclictest0-21swapper/120:46:041
1055699120,11cyclictest0-21swapper/100:35:431
1055699120,11cyclictest0-21swapper/100:25:091
1055699120,10cyclictest0-21swapper/119:27:121
1055899118,2cyclictest0-21swapper/320:45:503
1055899118,2cyclictest0-21swapper/320:15:163
1055899116,3cyclictest22228-21grep19:36:033
1055799112,6cyclictest0-21swapper/220:16:582
1055799111,8cyclictest21481-21ssh21:39:532
1055799110,2cyclictest25583-21diskmemload22:37:152
1055699118,2cyclictest1969-21copy20:10:001
1055699117,2cyclictest0-21swapper/120:25:121
1055699111,2cyclictest4846-21perl20:15:141
1055699111,2cyclictest22280-21apt-get22:15:111
1055699111,2cyclictest0-21swapper/119:40:131
1055699110,9cyclictest0-21swapper/120:50:111
1055699110,9cyclictest0-21swapper/119:55:171
259512100,2sleep20-21swapper/200:39:092
167122100,2sleep20-21swapper/223:19:162
1055899107,2cyclictest0-21swapper/319:40:453
1055899101,6cyclictest0-21swapper/320:56:003
1055799104,4cyclictest5458-21sh21:56:032
1055799102,7cyclictest0-21swapper/222:58:582
1055799102,5cyclictest0-21swapper/200:33:582
1055799100,7cyclictest4562-21gdm-simple-gree23:06:582
1055699101,3cyclictest30936-21munin-node1
27475290,5sleep20-21swapper/223:30:222
105589996,2cyclictest0-21swapper/320:00:153
105589996,2cyclictest0-21swapper/319:20:173
105589996,2cyclictest0-21swapper/319:16:053
105589994,3cyclictest24274-21fschecks_time21:05:153
105589994,3cyclictest21909-21telnet21:00:123
105589993,3cyclictest10519-21kworker/u8:119:45:103
105589990,6cyclictest0-21swapper/319:30:593
105579994,3cyclictest3728-21runrttasks20:29:452
105579992,6cyclictest0-21swapper/220:40:142
105579990,2cyclictest0-21swapper/222:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional