You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-10 - 21:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack3slot6s.osadl.org (updated Sat Jan 10, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
288982117105,6sleep20-21swapper/207:05:232
29517211697,14sleep10-21swapper/107:08:101
294332114103,6sleep00-21swapper/007:07:040
29471211093,12sleep30-21swapper/307:07:363
2367221030,1sleep223656-21/usr/sbin/munin12:20:002
163132840,0sleep10-21swapper/109:47:351
59582760,4sleep02968999cyclictest08:50:110
284392750,2sleep337-21rcuc/311:12:233
277662700,0sleep30-21swapper/312:24:223
29692995317,18cyclictest0-21swapper/312:15:113
36722250,1sleep20-21swapper/209:34:382
29690992319,2cyclictest0-21swapper/108:40:131
17612230,1sleep10-21swapper/110:07:191
17612230,1sleep10-21swapper/110:07:191
327002220,1sleep0101ktimersoftd/011:53:480
2969299220,20cyclictest0-21swapper/309:55:103
247962220,1sleep229-21rcuc/209:20:282
2969099211,18cyclictest0-21swapper/111:20:101
2969099211,18cyclictest0-21swapper/108:05:101
2969099210,4cyclictest0-21swapper/112:35:041
2969299200,15cyclictest0-21swapper/310:19:043
2969299200,15cyclictest0-21swapper/309:53:033
2969299200,15cyclictest0-21swapper/308:37:043
2969099201,17cyclictest0-21swapper/109:35:111
2969299191,8cyclictest0-21swapper/309:30:043
2969299191,17cyclictest0-21swapper/309:11:043
29691991915,2cyclictest19998-21kworker/u8:211:05:042
2969299180,14cyclictest0-21swapper/307:53:033
29692991714,2cyclictest17599-21kworker/u8:010:29:033
2969299170,2cyclictest0-21swapper/308:43:043
2969199171,2cyclictest0-21swapper/211:47:052
2969199170,2cyclictest0-21swapper/210:42:042
29692991611,3cyclictest12833-21sed09:05:173
2969299160,2cyclictest0-21swapper/311:47:053
2969299160,2cyclictest0-21swapper/310:42:043
2969299160,2cyclictest0-21swapper/310:33:053
2969299160,2cyclictest0-21swapper/308:48:043
2969299160,15cyclictest0-21swapper/310:06:053
2969299160,15cyclictest0-21swapper/310:06:043
2969299160,14cyclictest2673-21df_abs11:20:133
2969299160,14cyclictest0-21swapper/311:25:033
2969199162,2cyclictest0-21swapper/207:44:052
29691991611,3cyclictest29902-21munin-node2
29691991611,3cyclictest27031-21ssh10:00:142
2969099161,3cyclictest0-21swapper/112:20:241
2969099161,3cyclictest0-21swapper/111:15:051
2969099161,3cyclictest0-21swapper/109:25:031
2969099161,13cyclictest29611-21df_abs11:50:121
2969099161,13cyclictest13777-21diskmemload12:02:521
2969099161,13cyclictest0-21swapper/111:25:121
29689991613,2cyclictest24905-21kworker/u8:111:19:040
29689991613,2cyclictest24905-21kworker/u8:111:10:050
2968999160,15cyclictest0-21swapper/012:15:110
2968999160,14cyclictest0-21swapper/007:55:110
57262150,2sleep00-21swapper/010:47:130
29692991512,2cyclictest3447-21kworker/u8:112:38:053
29692991512,2cyclictest31452-21kworker/u8:110:12:043
29692991512,2cyclictest28127-21kworker/u8:212:33:043
29692991512,2cyclictest21836-21kworker/u8:109:21:043
2969299151,12cyclictest28142-21apt-get12:25:053
2969299151,12cyclictest13678-21iostat10:20:153
2969299150,6cyclictest0-21swapper/307:36:043
2969299150,3cyclictest18274-21ssh11:37:023
2969299150,2cyclictest0-21swapper/309:41:033
2969299150,2cyclictest0-21swapper/309:28:043
2969299150,13cyclictest21971-21date08:10:003
2969299150,13cyclictest0-21swapper/312:13:153
2969199152,11cyclictest0-21swapper/211:40:012
29691991512,2cyclictest4195-21kworker/u8:109:58:042
29691991512,2cyclictest27339-21kworker/u8:107:57:042
29691991512,2cyclictest24905-21kworker/u8:111:21:052
2969199151,12cyclictest6675-21snmpd10:48:262
2969199150,3cyclictest0-21swapper/208:50:212
2969199150,13cyclictest0-21swapper/210:56:432
2969099159,4cyclictest3176-21apt-get10:45:111
2969099159,2cyclictest0-21swapper/109:30:551
29690991513,1cyclictest0-21swapper/109:58:501
2969099151,12cyclictest23-21ksoftirqd/108:20:141
29690991510,3cyclictest24722-21modprobe08:15:141
29690991510,3cyclictest0-21swapper/112:13:101
29690991510,3cyclictest0-21swapper/110:55:111
2969099150,13cyclictest13777-21diskmemload09:22:091
2968999150,5cyclictest0-21swapper/007:15:010
29692991411,2cyclictest7816-21ssh10:50:023
29692991411,2cyclictest4195-21kworker/u8:109:47:043
29692991411,2cyclictest19998-21kworker/u8:211:04:043
29692991411,2cyclictest13777-21diskmemload11:42:323
29692991410,2cyclictest30458-21python11:50:233
29692991410,2cyclictest0-21swapper/307:10:153
2969299140,2cyclictest0-21swapper/312:07:033
2969299140,2cyclictest0-21swapper/311:57:323
2969299140,2cyclictest0-21swapper/309:16:043
2969299140,2cyclictest0-21swapper/308:15:113
2969299140,2cyclictest0-21swapper/307:44:053
2969299140,12cyclictest13777-21diskmemload09:35:113
2969299140,12cyclictest11866-21cut11:30:143
2969299140,12cyclictest0-21swapper/310:56:273
2969199149,3cyclictest0-21swapper/208:20:262
2969199141,2cyclictest0-21swapper/207:20:042
29691991411,2cyclictest7423-21kworker/u8:007:38:042
29691991411,2cyclictest5071-21kworker/u8:110:51:032
29691991411,2cyclictest29898-21kworker/u8:207:32:052
29691991411,2cyclictest0-21swapper/210:23:222
2969199140,3cyclictest6683-21diskmemload10:12:552
2969199140,2cyclictest0-21swapper/207:15:242
2969199140,13cyclictest0-21swapper/210:25:222
2969199140,12cyclictest21214-21switchtime08:05:242
2969199140,12cyclictest0-21swapper/212:23:322
2969199140,12cyclictest0-21swapper/211:37:122
2969199140,12cyclictest0-21swapper/211:02:572
2969199140,12cyclictest0-21swapper/209:12:052
29690991411,2cyclictest13777-21diskmemload10:34:101
29690991411,2cyclictest0-21swapper/112:30:151
29690991410,2cyclictest12148-21latency_hist10:55:001
2969099140,13cyclictest0-21swapper/110:41:501
2969099140,13cyclictest0-21swapper/109:54:301
2969099140,12cyclictest328750irq/24-eth111:10:231
2969099140,12cyclictest0-21swapper/112:16:411
2969099140,12cyclictest0-21swapper/107:55:211
2968999140,13cyclictest0-21swapper/007:39:010
124362140,2sleep013777-21diskmemload09:43:460
29692991310,2cyclictest24905-21kworker/u8:111:17:043
29692991310,2cyclictest0-21swapper/310:00:473
2969299130,2cyclictest0-21swapper/310:45:043
2969299130,2cyclictest0-21swapper/308:00:153
2969299130,2cyclictest0-21swapper/307:20:043
2969299130,12cyclictest0-21swapper/312:02:573
2969299130,12cyclictest0-21swapper/310:35:173
2969299130,12cyclictest0-21swapper/308:24:043
2969299130,11cyclictest0-21swapper/311:05:193
2969199139,2cyclictest30328-21ssh12:25:542
2969199138,3cyclictest0-21swapper/209:25:132
29691991310,2cyclictest28736-21kworker/u8:211:57:042
29691991310,2cyclictest0-21swapper/212:01:292
29691991310,2cyclictest0-21swapper/211:30:172
29691991310,2cyclictest0-21swapper/211:28:292
29691991310,2cyclictest0-21swapper/209:00:142
29691991310,2cyclictest0-21swapper/209:00:012
29691991310,2cyclictest0-21swapper/208:45:172
2969199130,3cyclictest0-21swapper/209:50:342
2969199130,2cyclictest12237-21ssh10:19:182
2969199130,2cyclictest0-21swapper/209:47:292
2969199130,2cyclictest0-21swapper/207:45:152
2969199130,12cyclictest0-21swapper/212:30:062
2969199130,12cyclictest0-21swapper/211:51:262
2969199130,12cyclictest0-21swapper/211:10:112
2969199130,12cyclictest0-21swapper/209:40:232
2969199130,12cyclictest0-21swapper/209:18:412
2969199130,12cyclictest0-21swapper/208:30:182
2969199130,12cyclictest0-21swapper/207:50:122
2969199130,11cyclictest0-21swapper/212:10:592
2969199130,11cyclictest0-21swapper/212:08:002
2969199130,11cyclictest0-21swapper/209:36:512
2969199130,11cyclictest0-21swapper/208:15:222
2969099138,3cyclictest0-21swapper/108:50:141
2969099133,7cyclictest6318-21Xorg08:01:581
29690991311,1cyclictest0-21swapper/111:00:201
29690991310,2cyclictest0-21swapper/110:20:171
29690991310,2cyclictest0-21swapper/110:01:411
29690991310,2cyclictest0-21swapper/107:15:181
2969099130,2cyclictest13777-21diskmemload10:28:441
2969099130,2cyclictest13777-21diskmemload09:12:021
2969099130,2cyclictest0-21swapper/111:37:321
2969099130,2cyclictest0-21swapper/111:05:301
2969099130,2cyclictest0-21swapper/110:11:401
2969099130,2cyclictest0-21swapper/107:40:111
2969099130,12cyclictest21-21rcuc/107:10:161
2969099130,12cyclictest0-21swapper/112:26:011
2969099130,12cyclictest0-21swapper/112:06:101
2969099130,12cyclictest0-21swapper/109:18:291
2969099130,11cyclictest13777-21diskmemload11:41:121
2969099130,11cyclictest0-21swapper/110:35:311
29689991310,2cyclictest0-21swapper/011:41:530
29689991310,2cyclictest0-21swapper/010:32:140
29689991310,2cyclictest0-21swapper/010:05:450
29689991310,2cyclictest0-21swapper/010:05:450
29689991310,2cyclictest0-21swapper/009:53:450
29689991310,2cyclictest0-21swapper/007:30:140
2968999130,2cyclictest0-21swapper/012:05:260
2968999130,2cyclictest0-21swapper/010:53:150
2968999130,2cyclictest0-21swapper/008:05:240
2968999130,12cyclictest0-21swapper/009:33:350
2968999130,11cyclictest0-21swapper/011:28:250
2968999130,11cyclictest0-21swapper/009:05:200
198232130,1sleep00-21swapper/010:26:510
168702130,2sleep00-21swapper/010:24:360
49052120,2sleep10-21swapper/108:45:261
2969299129,2cyclictest24141-21kworker/u8:108:50:043
2969299129,2cyclictest20216-21kworker/u8:008:30:053
2969299129,2cyclictest20216-21kworker/u8:008:12:043
2969299129,2cyclictest10007-21kworker/u8:207:48:043
2969299122,7cyclictest0-21swapper/307:30:013
2969199129,2cyclictest27339-21kworker/u8:107:29:042
2969199129,2cyclictest24141-21kworker/u8:109:05:042
2969199129,2cyclictest20216-21kworker/u8:008:29:032
2969199129,2cyclictest0-21swapper/210:05:182
2969199129,2cyclictest0-21swapper/210:05:172
2969199121,9cyclictest30013-21copy11:15:012
2969199120,2cyclictest0-21swapper/212:36:052
2969199120,2cyclictest0-21swapper/210:35:042
2969199120,10cyclictest0-21swapper/210:30:312
2969099129,2cyclictest0-21swapper/111:57:101
2969099121,9cyclictest0-21swapper/111:45:241
2969099121,3cyclictest0-21swapper/109:00:161
2969099121,3cyclictest0-21swapper/107:35:151
2969099120,7cyclictest0-21swapper/107:30:001
2969099120,3cyclictest0-21swapper/109:05:171
2969099120,1cyclictest0-21swapper/107:50:231
2969099120,11cyclictest0-21swapper/111:30:481
2969099120,11cyclictest0-21swapper/110:19:311
2969099120,11cyclictest0-21swapper/109:41:411
2969099120,11cyclictest0-21swapper/108:55:101
2969099120,11cyclictest0-21swapper/107:30:141
2969099120,10cyclictest0-21swapper/107:45:261
2968999129,2cyclictest9972-21apt-get07:40:090
2968999129,2cyclictest6174-21kworker/u8:210:42:040
2968999129,2cyclictest0-21swapper/012:25:160
2968999129,2cyclictest0-21swapper/012:21:130
2968999129,2cyclictest0-21swapper/012:11:120
2968999129,2cyclictest0-21swapper/011:48:520
2968999129,2cyclictest0-21swapper/011:06:050
2968999129,2cyclictest0-21swapper/010:36:150
2968999129,2cyclictest0-21swapper/009:29:570
2968999129,2cyclictest0-21swapper/007:25:240
2968999120,2cyclictest0-21swapper/011:35:230
2968999120,2cyclictest0-21swapper/011:30:240
2968999120,2cyclictest0-21swapper/011:03:120
2968999120,2cyclictest0-21swapper/010:18:130
2968999120,2cyclictest0-21swapper/009:55:330
2968999120,2cyclictest0-21swapper/009:38:260
2968999120,11cyclictest16227-21ssh09:11:260
2968999120,11cyclictest0-21swapper/012:34:540
2968999120,11cyclictest0-21swapper/012:03:150
2968999120,11cyclictest0-21swapper/011:58:050
2968999120,11cyclictest0-21swapper/010:01:430
2968999120,11cyclictest0-21swapper/008:20:160
2968999120,10cyclictest0-21swapper/011:21:020
2969299118,2cyclictest24141-21kworker/u8:109:01:043
2969299118,2cyclictest0-21swapper/307:55:153
2969199118,2cyclictest27339-21kworker/u8:108:01:042
2969199110,1cyclictest0-21swapper/208:40:172
2969099116,3cyclictest30128-21munin-node1
2969099110,9cyclictest1546-21aten2.4-expect07:20:121
2968999118,2cyclictest0-21swapper/010:55:040
2968999118,2cyclictest0-21swapper/008:55:140
2968999118,2cyclictest0-21swapper/008:25:180
2968999110,9cyclictest0-21swapper/009:20:400
2968999110,2cyclictest0-21swapper/009:45:250
2968999110,2cyclictest0-21swapper/007:50:540
2968999110,10cyclictest24141-21kworker/u8:108:40:040
2968999110,10cyclictest21020-21ssh09:16:440
2968999110,10cyclictest0-21swapper/012:36:550
2968999110,10cyclictest0-21swapper/010:10:330
2969299107,2cyclictest27339-21kworker/u8:107:25:043
2969199107,2cyclictest24141-21kworker/u8:108:39:032
2969199100,6cyclictest0-21swapper/208:11:042
2969099102,6cyclictest0-21swapper/108:12:561
2969099101,7cyclictest0-21swapper/108:35:131
2969099101,5cyclictest0-21swapper/108:25:111
2968999107,2cyclictest0-21swapper/007:45:060
31886290,1sleep00-21swapper/008:34:420
30619290,6sleep00-21swapper/007:10:160
296929996,2cyclictest27339-21kworker/u8:107:15:053
296929996,2cyclictest20216-21kworker/u8:008:25:043
296899995,3cyclictest24074-21apt08:15:100
296899994,3cyclictest2364-21ntpdc07:20:180
296929983,3cyclictest7239-21upowerd08:55:053
296899985,2cyclictest10037-21aten2.4-expect09:00:130
296899985,2cyclictest0-21swapper/008:35:250
296899984,3cyclictest4104-21df_inode08:45:130
296899980,7cyclictest20216-21kworker/u8:008:10:050
296899980,7cyclictest0-21swapper/008:00:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional