You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-15 - 18:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sat Nov 15, 2025 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27003212198,18sleep30-21swapper/307:09:023
26995211392,16sleep00-21swapper/007:08:550
26970211292,15sleep20-21swapper/207:08:372
26753210277,18sleep10-21swapper/107:05:481
17742900,0sleep30-21swapper/312:22:533
49892770,1sleep011-21rcuc/011:18:490
116422770,1sleep10-21swapper/110:50:441
219502720,0sleep20-21swapper/211:01:552
172712710,0sleep10-21swapper/108:05:001
165712670,0sleep20-21swapper/212:38:352
311882640,1sleep00-21swapper/007:20:000
27112994316,25cyclictest0-21swapper/307:40:133
2711099391,36cyclictest0-21swapper/112:15:141
12572260,0sleep20-21swapper/212:22:042
54362240,0sleep30-21swapper/308:55:143
2710999230,21cyclictest0-21swapper/009:45:040
279922220,0sleep00-21swapper/011:08:590
27112992118,2cyclictest25490-21kworker/u8:012:16:053
27112992118,2cyclictest13320-21kworker/u8:009:21:043
27112992118,2cyclictest1251-21kworker/u8:310:07:043
2711299210,19cyclictest0-21swapper/312:10:143
27111992118,2cyclictest20652-21kworker/u8:312:19:052
27111992118,2cyclictest19006-21kworker/u8:211:46:012
27112992017,2cyclictest13518-21kworker/u8:011:34:053
27112992016,2cyclictest9529-21kworker/u8:209:13:043
27110992015,3cyclictest26939-21ssh10:00:141
2710999202,16cyclictest0-21swapper/011:47:040
2710999200,18cyclictest0-21swapper/012:25:120
2710999200,18cyclictest0-21swapper/010:05:140
2710999200,18cyclictest0-21swapper/007:25:130
27112991916,2cyclictest9529-21kworker/u8:209:46:053
27112991916,2cyclictest30655-21kworker/u8:011:15:043
27112991916,2cyclictest17659-21kworker/u8:111:01:043
27112991916,2cyclictest10591-21kworker/u8:112:38:053
27112991915,2cyclictest1251-21kworker/u8:310:30:013
27112991912,6cyclictest0-21swapper/308:25:123
2711299190,2cyclictest11163-21diskmemload11:54:043
2711299190,2cyclictest11163-21diskmemload09:54:023
27111991916,2cyclictest8695-21kworker/u8:211:25:052
27111991916,2cyclictest6883-21kworker/u8:010:13:042
27112991815,2cyclictest9529-21kworker/u8:209:35:043
27112991815,2cyclictest9529-21kworker/u8:209:18:043
27112991815,2cyclictest15903-21kworker/u8:110:22:053
27112991815,2cyclictest1251-21kworker/u8:310:27:043
27111991815,2cyclictest9529-21kworker/u8:209:10:022
27111991815,2cyclictest3443-21kworker/u8:111:23:042
27111991815,2cyclictest3443-21kworker/u8:111:23:042
27111991815,2cyclictest30649-21kworker/u8:007:43:042
27111991815,2cyclictest19006-21kworker/u8:211:42:052
2711199180,2cyclictest0-21swapper/211:54:052
2711199180,2cyclictest0-21swapper/209:54:012
2711199180,16cyclictest0-21swapper/210:46:052
27112991714,2cyclictest8695-21kworker/u8:211:26:053
27112991714,2cyclictest4000-21kworker/u8:111:55:043
27112991714,2cyclictest32674-21kworker/u8:310:50:013
27112991714,2cyclictest30655-21kworker/u8:011:20:043
27112991714,2cyclictest30655-21kworker/u8:011:20:043
27112991714,2cyclictest24099-21kworker/u8:311:11:043
27112991714,2cyclictest14995-21kworker/u8:008:04:023
27112991714,2cyclictest13518-21kworker/u8:011:38:013
27111991714,2cyclictest31672-21kworker/u8:210:44:062
27111991714,2cyclictest20652-21kworker/u8:312:09:042
27111991714,2cyclictest15903-21kworker/u8:110:23:042
2711199170,2cyclictest0-21swapper/211:08:062
2711199170,2cyclictest0-21swapper/209:48:042
27112991613,2cyclictest9529-21kworker/u8:209:43:043
27112991613,2cyclictest9529-21kworker/u8:209:28:063
27112991613,2cyclictest9529-21kworker/u8:209:06:013
27112991613,2cyclictest31672-21kworker/u8:210:44:023
27112991613,2cyclictest29166-21kworker/u8:009:30:053
27112991613,2cyclictest21365-21kworker/u8:010:39:043
27112991613,2cyclictest14995-21kworker/u8:008:08:043
27112991613,2cyclictest10763-21kworker/u8:009:58:053
2711299160,2cyclictest14610-21ssh10:55:043
2711299160,2cyclictest0-21swapper/311:08:053
2711299160,14cyclictest0-21swapper/310:45:043
27111991613,2cyclictest4402-21kworker/u8:109:40:012
27111991613,2cyclictest3243-21kworker/u8:109:02:042
27111991613,2cyclictest27395-21kworker/u8:207:15:042
27111991613,2cyclictest24099-21kworker/u8:311:14:052
27111991613,2cyclictest14995-21kworker/u8:008:03:052
27111991613,2cyclictest13320-21kworker/u8:009:16:052
27111991613,2cyclictest1251-21kworker/u8:310:25:042
27111991613,2cyclictest10763-21kworker/u8:009:55:042
2711199160,2cyclictest0-21swapper/210:55:042
2711099165,9cyclictest0-21swapper/108:25:131
2711099161,13cyclictest23877-21munin-plugin-st11:05:001
27112991512,2cyclictest8909-21kworker/u8:208:21:043
27112991512,2cyclictest6883-21kworker/u8:010:16:053
27112991512,2cyclictest5475-21kworker/u8:012:31:043
27112991512,2cyclictest3243-21kworker/u8:108:53:043
27112991512,2cyclictest31682-21kworker/u8:008:48:043
27112991512,2cyclictest27395-21kworker/u8:207:33:043
27112991512,2cyclictest27395-21kworker/u8:207:12:053
27112991512,2cyclictest19636-21kworker/u8:108:38:023
27112991512,2cyclictest14995-21kworker/u8:007:59:043
27112991512,2cyclictest1251-21kworker/u8:310:12:043
2711299151,12cyclictest12825-21apt-get07:52:363
27112991510,3cyclictest27021-21ssh11:40:463
2711299150,13cyclictest0-21swapper/312:01:263
2711199151,3cyclictest0-21swapper/210:07:482
27111991512,2cyclictest6801-21kworker/u8:107:52:042
27111991512,2cyclictest3243-21kworker/u8:108:55:042
27111991512,2cyclictest30649-21kworker/u8:007:20:042
27111991512,2cyclictest27646-21kworker/u8:208:32:042
27111991512,2cyclictest27395-21kworker/u8:207:32:042
27111991512,2cyclictest26338-21kworker/u8:110:36:012
27111991512,2cyclictest19636-21kworker/u8:108:26:052
27111991512,2cyclictest19636-21kworker/u8:108:19:042
27111991512,2cyclictest13518-21kworker/u8:011:39:042
2711199151,12cyclictest3438-21apt-get12:25:122
2711199150,2cyclictest0-21swapper/211:56:052
2711199150,14cyclictest0-21swapper/209:20:102
2711199150,13cyclictest0-21swapper/210:01:042
27110991512,2cyclictest0-21swapper/110:12:521
27110991510,3cyclictest0-21swapper/111:10:161
2711099150,2cyclictest11163-21diskmemload12:10:421
2711099150,13cyclictest0-21swapper/111:55:021
2711099150,13cyclictest0-21swapper/109:43:351
2711099150,13cyclictest0-21swapper/108:55:131
2710999150,13cyclictest11163-21diskmemload09:40:170
27112991411,2cyclictest4000-21kworker/u8:112:05:043
27112991411,2cyclictest24489-21kworker/u8:111:45:043
27112991411,2cyclictest19636-21kworker/u8:108:16:013
2711299140,2cyclictest0-21swapper/308:40:153
2711199141,3cyclictest18336-21munin-node10:50:132
27111991411,2cyclictest30649-21kworker/u8:007:25:042
27111991411,2cyclictest29166-21kworker/u8:009:34:042
27111991411,2cyclictest27646-21kworker/u8:208:35:042
27111991411,2cyclictest27395-21kworker/u8:207:35:052
27111991411,2cyclictest0-21swapper/212:01:302
2711199140,6cyclictest0-21swapper/212:30:052
2711199140,13cyclictest0-21swapper/212:14:302
2711199140,12cyclictest0-21swapper/210:34:092
2711199140,12cyclictest0-21swapper/210:17:282
2711199140,12cyclictest0-21swapper/209:36:122
2711099142,7cyclictest0-21swapper/111:45:001
2711099142,7cyclictest0-21swapper/110:40:001
2711099142,6cyclictest0-21swapper/108:15:001
2711099141,2cyclictest9368-21apt-get09:05:131
27110991411,2cyclictest0-21swapper/111:32:021
27110991411,2cyclictest0-21swapper/109:59:521
27110991411,2cyclictest0-21swapper/109:19:231
2711099140,3cyclictest15414-21ssh09:14:141
2711099140,3cyclictest1377-21sh10:06:231
2711099140,2cyclictest0-21swapper/112:30:121
2711099140,2cyclictest0-21swapper/111:47:121
2711099140,2cyclictest0-21swapper/110:33:031
2711099140,13cyclictest0-21swapper/112:06:221
2711099140,13cyclictest0-21swapper/111:35:021
2711099140,13cyclictest0-21swapper/110:43:021
2711099140,12cyclictest26770-21ntpq09:25:181
2711099140,12cyclictest0-21swapper/109:49:131
27109991411,2cyclictest0-21swapper/012:39:260
27109991411,2cyclictest0-21swapper/011:25:560
2710999140,2cyclictest1452-21mailstats10:40:260
2710999140,2cyclictest0-21swapper/009:30:160
2710999140,12cyclictest0-21swapper/010:55:210
2710999140,12cyclictest0-21swapper/010:37:200
141652140,2sleep011163-21diskmemload12:01:180
9612130,2sleep10-21swapper/109:32:281
27112991310,2cyclictest6801-21kworker/u8:107:48:043
27112991310,2cyclictest30649-21kworker/u8:007:28:043
27112991310,2cyclictest19636-21kworker/u8:108:12:043
2711299130,8cyclictest0-21swapper/307:36:053
2711299130,2cyclictest0-21swapper/310:01:273
27111991310,2cyclictest6801-21kworker/u8:107:55:042
27111991310,2cyclictest6801-21kworker/u8:107:49:042
2711199130,2cyclictest0-21swapper/209:26:472
2711199130,12cyclictest0-21swapper/211:32:402
2711199130,12cyclictest0-21swapper/211:15:412
2711099132,6cyclictest4818-21apt-get07:35:001
2711099132,6cyclictest0-21swapper/109:55:001
2711099132,6cyclictest0-21swapper/108:45:001
2711099132,6cyclictest0-21swapper/107:25:001
2711099131,6cyclictest0-21swapper/107:45:001
2711099131,3cyclictest0-21swapper/111:50:191
27110991310,2cyclictest0-21swapper/112:35:031
27110991310,2cyclictest0-21swapper/111:06:521
27110991310,2cyclictest0-21swapper/110:26:431
27110991310,2cyclictest0-21swapper/110:15:131
27110991310,2cyclictest0-21swapper/109:36:231
27110991310,2cyclictest0-21swapper/108:45:211
2711099130,2cyclictest0-21swapper/112:01:221
2711099130,2cyclictest0-21swapper/110:59:511
2711099130,2cyclictest0-21swapper/107:52:361
2711099130,1cyclictest0-21swapper/112:28:021
2711099130,12cyclictest0-21swapper/111:15:021
2711099130,12cyclictest0-21swapper/110:21:341
2711099130,12cyclictest0-21swapper/109:20:421
27109991310,2cyclictest0-21swapper/012:09:410
27109991310,2cyclictest0-21swapper/011:35:500
27109991310,2cyclictest0-21swapper/011:33:560
2710999130,2cyclictest0-21swapper/011:13:510
2710999130,2cyclictest0-21swapper/009:12:060
2710999130,2cyclictest0-21swapper/008:55:190
2710999130,2cyclictest0-21swapper/008:45:140
2710999130,12cyclictest0-21swapper/010:21:160
2710999130,12cyclictest0-21swapper/010:03:360
2710999130,11cyclictest15420-21munin-node0
2710999130,11cyclictest11163-21diskmemload10:54:010
2710999130,11cyclictest0-21swapper/011:55:490
162792131,9sleep016268-21munin-node0
35892120,2sleep00-21swapper/011:50:280
2711299129,2cyclictest20652-21kworker/u8:312:25:053
2711199129,2cyclictest31682-21kworker/u8:008:46:012
2711199129,2cyclictest19636-21kworker/u8:108:40:042
2711199129,2cyclictest0-21swapper/208:20:222
2711199129,2cyclictest0-21swapper/208:10:202
2711199120,11cyclictest0-21swapper/207:10:132
2711099129,2cyclictest0-21swapper/111:25:071
2711099129,2cyclictest0-21swapper/108:15:151
2711099129,2cyclictest0-21swapper/108:05:171
2711099127,3cyclictest3142-21munin-node1
2711099121,9cyclictest0-21swapper/108:20:271
2711099121,9cyclictest0-21swapper/107:15:161
2711099121,3cyclictest5063-21munin-node1
2711099120,11cyclictest11163-21diskmemload12:20:171
2711099120,11cyclictest0-21swapper/111:20:251
2711099120,11cyclictest0-21swapper/111:20:251
2711099120,11cyclictest0-21swapper/110:46:241
2711099120,11cyclictest0-21swapper/107:25:171
2711099120,10cyclictest0-21swapper/107:10:201
2710999129,2cyclictest12335-21sensors07:50:250
2710999129,2cyclictest0-21swapper/012:23:110
2710999129,2cyclictest0-21swapper/011:42:320
2710999129,2cyclictest0-21swapper/011:02:160
2710999129,2cyclictest0-21swapper/010:46:390
2710999129,2cyclictest0-21swapper/010:27:090
2710999129,2cyclictest0-21swapper/010:16:510
2710999129,2cyclictest0-21swapper/010:11:420
2710999129,2cyclictest0-21swapper/009:55:350
2710999120,2cyclictest0-21swapper/009:22:210
2710999120,11cyclictest0-21swapper/012:16:210
2710999120,11cyclictest0-21swapper/010:34:520
2710999120,11cyclictest0-21swapper/009:50:110
2710999120,11cyclictest0-21swapper/009:26:080
2710999120,11cyclictest0-21swapper/009:05:230
2710999120,11cyclictest0-21swapper/008:20:140
2710999120,11cyclictest0-21swapper/008:05:260
2710999120,10cyclictest11163-21diskmemload12:10:060
2711299112,7cyclictest0-21swapper/309:02:593
2711199112,7cyclictest0-21swapper/209:06:012
2711199110,2cyclictest0-21swapper/208:52:052
2711099118,2cyclictest0-21swapper/107:45:271
2711099114,6cyclictest0-21swapper/108:35:151
2711099110,9cyclictest0-21swapper/107:55:131
2710999118,2cyclictest0-21swapper/009:37:290
2710999118,2cyclictest0-21swapper/008:35:140
2710999118,2cyclictest0-21swapper/007:40:270
2710999118,2cyclictest0-21swapper/007:20:180
2710999116,3cyclictest7694-21head11:20:270
2710999116,3cyclictest7694-21head11:20:260
83512100,2sleep00-21swapper/009:00:210
2711099100,3cyclictest0-21swapper/108:30:161
2710999107,2cyclictest0-21swapper/012:30:070
271129996,2cyclictest19636-21kworker/u8:108:30:043
271129996,2cyclictest0-21swapper/307:15:253
271129994,3cyclictest31421-21aten2.4_r3power07:20:143
271119994,3cyclictest17918-21fschecks_time08:05:152
271109990,3cyclictest7358-21munin-node1
271099996,2cyclictest28229-21uname08:30:170
271099996,2cyclictest0-21swapper/008:28:190
271099996,2cyclictest0-21swapper/007:55:150
271099994,3cyclictest5298-21cpuspeed_turbos07:35:140
271099990,2cyclictest0-21swapper/008:54:510
271099985,2cyclictest4367-21nscd07:45:190
271099984,2cyclictest5129-21runrttasks07:10:380
271099983,3cyclictest4508-21dbus-daemon08:10:040
271099983,3cyclictest3881-21open_inodes07:30:190
271099974,2cyclictest31707-21aten2.4-expect08:40:150
271099970,2cyclictest0-21swapper/008:15:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional