You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 13:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Wed Dec 10, 2025 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24865211896,17sleep30-21swapper/319:07:263
24818211897,16sleep10-21swapper/119:06:481
24859211796,16sleep20-21swapper/219:07:212
24837211793,19sleep00-21swapper/019:07:030
161282770,1sleep30-21swapper/323:30:153
161282770,1sleep30-21swapper/323:30:153
320122750,0sleep00-21swapper/023:45:510
201642740,0sleep10-21swapper/121:54:451
220022650,6sleep12509499cyclictest22:30:001
171722550,1sleep30-21swapper/321:50:263
25093993416,16cyclictest0-21swapper/021:00:130
13062230,0sleep20-21swapper/220:50:172
2509499210,19cyclictest0-21swapper/122:15:101
74112200,0sleep00-21swapper/022:15:000
64852200,0sleep30-21swapper/323:53:563
25096992017,2cyclictest661-21kworker/u8:122:29:033
2509699200,2cyclictest0-21swapper/300:35:123
2509599200,2cyclictest0-21swapper/220:10:152
2509399200,18cyclictest0-21swapper/020:40:120
25096991916,2cyclictest661-21kworker/u8:122:08:043
25096991916,2cyclictest5883-21kworker/u8:123:57:053
32092180,1sleep121-21rcuc/121:36:131
25096991815,2cyclictest8630-21kworker/u8:019:52:013
25096991815,2cyclictest8574-21kworker/u8:221:07:043
25096991815,2cyclictest5087-21kworker/u8:223:13:043
25096991815,2cyclictest5087-21kworker/u8:223:06:043
25096991815,2cyclictest31039-21kworker/u8:219:46:043
25096991815,2cyclictest3081-21kworker/u8:120:57:043
25096991815,2cyclictest24952-21kworker/u8:022:34:013
25096991815,2cyclictest20829-21kworker/u8:221:24:043
25096991815,2cyclictest19348-21kworker/u8:021:13:043
25096991815,2cyclictest13253-21kworker/u8:220:18:013
25096991815,2cyclictest12522-21kworker/u8:121:15:043
2509599183,2cyclictest0-21swapper/223:15:132
25093991815,2cyclictest8542-21kworker/u8:123:41:050
25093991815,2cyclictest16712-21kworker/u8:000:10:050
25096991714,2cyclictest661-21kworker/u8:122:24:043
25096991714,2cyclictest661-21kworker/u8:122:18:043
25096991714,2cyclictest5087-21kworker/u8:223:27:043
25096991714,2cyclictest5087-21kworker/u8:223:02:013
25096991714,2cyclictest31039-21kworker/u8:219:28:013
25096991714,2cyclictest3081-21kworker/u8:121:00:033
25096991714,2cyclictest28875-21kworker/u8:023:20:013
25096991714,2cyclictest16712-21kworker/u8:000:05:043
2509699171,14cyclictest0-21swapper/321:35:473
2509699170,2cyclictest0-21swapper/322:01:043
2509699170,2cyclictest0-21swapper/320:34:013
2509699170,13cyclictest0-21swapper/322:54:593
25093991714,2cyclictest24952-21kworker/u8:022:45:040
25096991613,2cyclictest8630-21kworker/u8:019:56:043
25096991613,2cyclictest8542-21kworker/u8:123:35:043
25096991613,2cyclictest5087-21kworker/u8:223:15:043
25096991613,2cyclictest4413-21kworker/u8:119:43:043
25096991613,2cyclictest31039-21kworker/u8:219:37:043
25096991613,2cyclictest27695-21kworker/u8:021:47:043
25096991613,2cyclictest24952-21kworker/u8:022:35:043
25096991613,2cyclictest15998-21kworker/u8:022:58:013
25096991613,2cyclictest13253-21kworker/u8:220:20:043
25096991613,2cyclictest11415-21kworker/u8:200:14:043
2509699160,12cyclictest0-21swapper/320:36:003
2509699160,12cyclictest0-21swapper/319:22:043
2509699160,11cyclictest0-21swapper/320:49:043
2509599163,7cyclictest2307-21ssh23:50:012
25095991611,3cyclictest14921-21ntp_states00:35:192
2509399160,3cyclictest0-21swapper/020:45:160
2509399160,14cyclictest13898-21grep22:20:260
25096991512,2cyclictest4413-21kworker/u8:120:01:043
25096991512,2cyclictest15364-21kworker/u8:221:55:043
25096991512,2cyclictest11415-21kworker/u8:200:34:043
25096991512,2cyclictest11415-21kworker/u8:200:18:043
25096991510,3cyclictest0-21swapper/323:40:183
2509699150,2cyclictest0-21swapper/321:43:043
2509699150,10cyclictest0-21swapper/320:52:013
2509599152,7cyclictest0-21swapper/222:10:002
2509599151,2cyclictest25456-21ssh23:40:142
25095991511,2cyclictest0-21swapper/223:20:202
25095991510,3cyclictest0-21swapper/200:20:282
2509599150,3cyclictest3116-21ssh21:36:042
2509599150,13cyclictest0-21swapper/222:30:142
2509599150,13cyclictest0-21swapper/222:15:032
2509599150,13cyclictest0-21swapper/221:57:042
2509499151,3cyclictest21873-21cat00:10:011
25094991512,2cyclictest0-21swapper/123:25:521
25094991511,2cyclictest29259-21latency_hist20:40:001
25094991510,3cyclictest9065-21sendmail-mta00:30:081
2509499150,13cyclictest0-21swapper/121:20:221
2509399152,8cyclictest13932-21ssh22:55:000
25093991512,2cyclictest19348-21kworker/u8:021:11:040
2509399151,12cyclictest0-21swapper/020:25:150
25093991510,3cyclictest17235-21ssh00:05:160
25093991510,3cyclictest0-21swapper/022:59:180
2509399150,2cyclictest8931-21diskmemload23:36:160
2509399150,2cyclictest1907-21ssh00:22:040
2509399150,2cyclictest0-21swapper/023:55:000
2509399150,13cyclictest0-21swapper/022:41:170
2509399150,13cyclictest0-21swapper/019:45:140
2509399150,12cyclictest0-21swapper/023:25:130
25096991411,2cyclictest27695-21kworker/u8:021:32:013
25096991411,2cyclictest27482-21kworker/u8:019:31:043
25096991411,2cyclictest13253-21kworker/u8:220:25:043
25096991410,2cyclictest0-21swapper/322:42:393
2509699140,2cyclictest0-21swapper/323:49:033
2509699140,2cyclictest0-21swapper/322:11:473
2509699140,2cyclictest0-21swapper/320:13:033
2509699140,2cyclictest0-21swapper/300:26:043
2509699140,2cyclictest0-21swapper/300:02:043
2509699140,13cyclictest25052-21ssh21:25:273
2509699140,12cyclictest7770-21ssh22:48:003
2509699140,12cyclictest27276-21latency_hist19:15:003
2509599141,3cyclictest23019-21ssh23:04:072
25095991411,2cyclictest0-21swapper/223:57:132
2509599140,2cyclictest0-21swapper/223:26:342
2509599140,2cyclictest0-21swapper/221:27:132
2509599140,2cyclictest0-21swapper/219:40:242
2509599140,13cyclictest0-21swapper/222:24:342
2509599140,13cyclictest0-21swapper/200:30:532
2509599140,12cyclictest8931-21diskmemload00:14:242
2509599140,12cyclictest11821-21iostat19:55:152
2509599140,12cyclictest0-21swapper/223:50:182
2509599140,12cyclictest0-21swapper/222:50:242
2509499143,9cyclictest29847-21latency_hist23:45:011
2509499141,2cyclictest26869-21munin-node1
2509499141,2cyclictest1490-21smartctl19:30:151
25094991411,2cyclictest0-21swapper/123:34:121
25094991411,2cyclictest0-21swapper/123:34:121
25094991411,2cyclictest0-21swapper/123:14:221
25094991411,2cyclictest0-21swapper/123:08:011
25094991411,2cyclictest0-21swapper/122:56:421
25094991411,2cyclictest0-21swapper/121:56:521
2509499140,2cyclictest0-21swapper/123:20:221
2509499140,2cyclictest0-21swapper/122:00:121
2509499140,2cyclictest0-21swapper/121:32:021
2509499140,2cyclictest0-21swapper/100:00:111
2509499140,13cyclictest0-21swapper/123:56:521
2509499140,12cyclictest0-21swapper/123:36:071
2509499140,12cyclictest0-21swapper/120:55:161
2509499140,12cyclictest0-21swapper/120:40:171
2509399149,3cyclictest12501-21unixbench_multi21:45:260
2509399149,3cyclictest0-21swapper/022:01:360
2509399142,8cyclictest16871-21ssh00:05:010
2509399141,2cyclictest17702-21sh21:18:410
25093991411,2cyclictest0-21swapper/023:15:060
25093991411,2cyclictest0-21swapper/022:38:460
2509399141,10cyclictest0-21swapper/019:16:590
2509399140,2cyclictest0-21swapper/023:03:260
2509399140,13cyclictest0-21swapper/023:55:160
2509399140,13cyclictest0-21swapper/023:30:260
2509399140,13cyclictest0-21swapper/023:30:250
2509399140,13cyclictest0-21swapper/022:28:560
2509399140,13cyclictest0-21swapper/021:20:160
60402130,1sleep00-21swapper/023:20:110
25096991310,2cyclictest0-21swapper/300:23:583
25095991310,2cyclictest8931-21diskmemload21:46:082
25095991310,2cyclictest8931-21diskmemload21:22:072
25095991310,2cyclictest0-21swapper/223:10:552
25095991310,2cyclictest0-21swapper/221:11:552
25095991310,2cyclictest0-21swapper/219:20:192
2509599130,2cyclictest0-21swapper/222:11:142
2509599130,2cyclictest0-21swapper/221:40:112
2509599130,2cyclictest0-21swapper/220:35:152
2509599130,2cyclictest0-21swapper/220:00:192
2509599130,2cyclictest0-21swapper/200:18:332
2509599130,12cyclictest0-21swapper/222:35:042
2509599130,12cyclictest0-21swapper/222:03:542
2509599130,12cyclictest0-21swapper/220:05:242
2509599130,12cyclictest0-21swapper/200:29:122
2509499131,2cyclictest8931-21diskmemload22:09:041
25094991310,2cyclictest0-21swapper/123:46:141
25094991310,2cyclictest0-21swapper/123:16:321
25094991310,2cyclictest0-21swapper/122:43:581
25094991310,2cyclictest0-21swapper/121:00:141
25094991310,2cyclictest0-21swapper/100:22:501
2509499130,2cyclictest0-21swapper/123:00:261
2509499130,2cyclictest0-21swapper/119:15:161
2509499130,12cyclictest0-21swapper/123:50:321
2509499130,12cyclictest0-21swapper/122:51:191
2509499130,12cyclictest0-21swapper/122:30:221
2509499130,12cyclictest0-21swapper/121:45:321
2509499130,12cyclictest0-21swapper/121:26:211
2509499130,12cyclictest0-21swapper/120:05:201
2509499130,11cyclictest0-21swapper/100:10:161
2509399138,3cyclictest14918-21ntp_states00:35:190
25093991310,2cyclictest8931-21diskmemload21:40:550
25093991310,2cyclictest0-21swapper/022:05:180
25093991310,2cyclictest0-21swapper/021:50:440
25093991310,2cyclictest0-21swapper/019:30:240
25093991310,2cyclictest0-21swapper/019:20:120
25093991310,2cyclictest0-21swapper/000:32:560
2509399130,2cyclictest0-21swapper/021:56:490
2509399130,12cyclictest0-21swapper/023:14:020
2509399130,12cyclictest0-21swapper/020:15:200
2509399130,12cyclictest0-21swapper/000:18:250
2509699122,7cyclictest0-21swapper/320:09:023
2509699120,2cyclictest0-21swapper/320:44:043
2509599129,2cyclictest8931-21diskmemload22:47:262
2509599129,2cyclictest8931-21diskmemload22:25:422
2509599129,2cyclictest26171-21ssh23:06:312
2509599129,2cyclictest0-21swapper/222:56:312
2509599129,2cyclictest0-21swapper/221:15:542
2509599129,2cyclictest0-21swapper/220:45:152
2509599129,2cyclictest0-21swapper/220:40:192
2509599129,2cyclictest0-21swapper/200:01:532
2509599122,7cyclictest0-21swapper/220:20:592
2509599122,6cyclictest0-21swapper/221:10:002
2509599120,2cyclictest31974-21ssh22:40:102
2509599120,2cyclictest0-21swapper/223:32:152
2509599120,2cyclictest0-21swapper/223:32:152
2509599120,2cyclictest0-21swapper/200:06:112
2509599120,11cyclictest0-21swapper/221:50:142
2509599120,11cyclictest0-21swapper/221:31:552
2509599120,10cyclictest8931-21diskmemload23:35:222
2509499129,2cyclictest0-21swapper/122:35:051
2509499129,2cyclictest0-21swapper/120:25:171
2509499129,2cyclictest0-21swapper/119:55:161
2509499128,3cyclictest0-21swapper/120:45:261
2509499121,9cyclictest6835-21kworker/1:119:50:131
2509499121,9cyclictest12575-21munin-node1
2509499121,9cyclictest0-21swapper/120:30:181
2509499121,3cyclictest4232-21unixbench_singl22:10:261
2509499120,2cyclictest0-21swapper/121:43:461
2509499120,2cyclictest0-21swapper/121:10:031
2509499120,11cyclictest0-21swapper/122:48:241
2509499120,11cyclictest0-21swapper/100:35:391
2509399129,2cyclictest8931-21diskmemload22:16:590
2509399129,2cyclictest0-21swapper/020:30:190
2509399127,3cyclictest29756-21ps21:30:190
2509399122,7cyclictest0-21swapper/019:50:590
2509399120,2cyclictest7334-21ssh00:27:480
2509399120,2cyclictest0-21swapper/021:25:100
2509399120,2cyclictest0-21swapper/019:55:230
2509399120,11cyclictest0-21swapper/023:05:330
2509399120,11cyclictest0-21swapper/022:30:160
2509399120,11cyclictest0-21swapper/021:35:060
40392110,1sleep20-21swapper/219:35:242
2509699118,2cyclictest0-21swapper/319:15:283
2509499118,2cyclictest0-21swapper/120:15:251
2509499118,2cyclictest0-21swapper/100:27:051
2509499111,8cyclictest3454-21perl19:35:151
2509499111,3cyclictest0-21swapper/119:45:151
2509499110,9cyclictest0-21swapper/120:20:181
2509499110,3cyclictest7433-21expr21:05:141
2509499110,3cyclictest17461-21cpuspeed_turbos20:10:161
2509499110,3cyclictest1209-21expr20:50:151
2509499110,2cyclictest0-21swapper/120:00:051
2509499110,10cyclictest0-21swapper/119:10:221
2509399118,2cyclictest13253-21kworker/u8:220:10:040
2509399118,2cyclictest0-21swapper/019:25:220
159652110,1sleep10-21swapper/121:15:571
260632100,0sleep20-21swapper/219:10:162
2509599107,2cyclictest0-21swapper/219:50:172
2509599105,3cyclictest1157-21tr19:30:132
2509599102,6cyclictest0-21swapper/219:25:242
2509599100,7cyclictest0-21swapper/221:01:022
2509499107,2cyclictest0-21swapper/119:40:151
2509499101,2cyclictest29352-21apt-get19:20:111
2509399102,7cyclictest0-21swapper/020:39:590
2509399101,6cyclictest0-21swapper/020:05:130
250959994,3cyclictest27318-21munin-node2
250959994,3cyclictest0-21swapper/220:55:152
250959991,6cyclictest0-21swapper/220:30:512
250959991,3cyclictest0-21swapper/219:48:212
250959990,2cyclictest0-21swapper/220:26:402
250949990,2cyclictest0-21swapper/119:25:131
250939994,3cyclictest7214-21aten2.4_r3power21:05:130
250939994,3cyclictest6505-21unixbench_singl19:40:250
250939994,3cyclictest3808-21ntp_kernel_pll_20:55:200
250939994,3cyclictest3008-21cut19:35:130
250939994,3cyclictest25707-21entropy19:10:140
250939994,3cyclictest22318-21sendmail_mailqu20:20:240
250939994,3cyclictest1762-21cut20:50:200
250939991,6cyclictest0-21swapper/020:00:450
250959983,3cyclictest19247-21chrt20:15:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional