You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-31 - 22:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sun May 31, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15432124114,6sleep00-21swapper/007:05:070
2633211094,11sleep20-21swapper/207:05:572
3082210696,6sleep10-21swapper/107:06:281
3073210377,6sleep30-21swapper/307:06:233
106842970,0sleep20-21swapper/211:14:222
183882920,0sleep00-21swapper/011:21:210
74112850,4sleep229-21rcuc/211:44:362
24932790,1sleep30-21swapper/311:39:453
237872760,1sleep20-21swapper/212:00:442
224002720,1sleep122401-21sh12:33:211
197262710,0sleep10-21swapper/111:23:271
322832690,0sleep20-21swapper/209:21:472
311062600,1sleep10-21swapper/111:01:031
13942520,1sleep01392-21ssh09:57:030
340899391,19cyclictest0-21swapper/107:10:121
129102360,1sleep00-21swapper/010:42:300
341099330,15cyclictest0-21swapper/307:10:123
3410992111,3cyclictest0-21swapper/311:42:173
3410992111,2cyclictest0-21swapper/309:49:523
341099211,11cyclictest19355-21rm09:41:563
3410992110,3cyclictest18041-21cut11:55:143
340899211,2cyclictest0-21swapper/112:20:101
3410991910,2cyclictest0-21swapper/311:28:073
341099190,3cyclictest0-21swapper/310:54:023
341099190,2cyclictest6006-21aten2.4-expect08:35:113
3409991916,2cyclictest18055-21kworker/u8:109:30:052
3409991916,2cyclictest15838-21kworker/u8:010:55:052
341099180,12cyclictest0-21swapper/312:12:303
341099180,12cyclictest0-21swapper/311:34:423
341099172,4cyclictest31019-21ssh09:54:593
3410991711,4cyclictest11417-21ssh11:15:103
3409991714,2cyclictest14010-21kworker/u8:011:18:042
3407991714,2cyclictest26751-21kworker/u8:111:01:050
340999161,3cyclictest0-21swapper/210:05:182
3409991613,2cyclictest31644-21kworker/u8:211:06:012
3409991613,2cyclictest27932-21kworker/u8:210:26:052
3409991613,2cyclictest25457-21kworker/u8:309:57:042
3409991613,2cyclictest18055-21kworker/u8:109:13:052
340899162,8cyclictest0-21swapper/108:40:011
340899161,13cyclictest0-21swapper/112:39:101
3407991613,2cyclictest5519-21kworker/u8:111:42:050
3407991613,2cyclictest31044-21kworker/u8:310:52:050
3407991613,2cyclictest16922-21kworker/u8:010:11:040
3407991613,2cyclictest16922-21kworker/u8:009:45:040
341099151,12cyclictest3822-21gzip09:25:593
341099150,13cyclictest3150-21nscd09:13:463
3409991512,2cyclictest31249-21kworker/u8:112:12:052
3409991512,2cyclictest31044-21kworker/u8:310:34:042
3409991512,2cyclictest12645-21ssh10:42:062
3409991511,2cyclictest6444-21cut07:15:152
340999151,12cyclictest1291-21/usr/sbin/munin11:05:012
340999150,13cyclictest0-21swapper/209:45:052
340899152,8cyclictest15841-21copy09:00:001
340899151,3cyclictest0-21swapper/112:26:011
340899151,12cyclictest19090-21ssh11:55:541
340899151,12cyclictest0-21swapper/112:13:081
3408991510,3cyclictest0-21swapper/108:10:161
340899150,3cyclictest0-21swapper/109:48:011
340899150,13cyclictest0-21swapper/109:57:391
340899150,13cyclictest0-21swapper/109:40:141
340899150,13cyclictest0-21swapper/109:16:201
3407991512,2cyclictest16922-21kworker/u8:009:53:050
3407991512,2cyclictest1460-21kworker/u8:208:44:040
340799150,13cyclictest19855-21diskmemload10:36:020
340799150,13cyclictest16668-21ssh12:26:530
3410991411,2cyclictest0-21swapper/308:45:113
3410991410,2cyclictest0-21swapper/309:30:273
341099140,2cyclictest0-21swapper/310:07:313
341099140,12cyclictest14027-21smartctl10:10:133
341099140,12cyclictest0-21swapper/310:46:143
341099140,12cyclictest0-21swapper/310:46:143
341099140,12cyclictest0-21swapper/310:35:213
341099140,12cyclictest0-21swapper/310:20:343
3409991411,2cyclictest3965-21kworker/u8:108:36:052
3409991411,2cyclictest3806-21kworker/u8:107:52:022
3409991411,2cyclictest26216-21kworker/u8:008:29:042
3409991411,2cyclictest0-21swapper/211:49:272
3409991411,2cyclictest0-21swapper/210:15:152
3409991410,3cyclictest0-21swapper/210:46:062
3409991410,3cyclictest0-21swapper/210:46:052
3409991410,2cyclictest0-21swapper/208:31:042
340999140,3cyclictest28216-21ssh12:05:202
340999140,12cyclictest0-21swapper/212:25:492
340999140,12cyclictest0-21swapper/209:35:182
340999140,12cyclictest0-21swapper/209:28:552
340899149,3cyclictest30964-21ssh09:20:231
340899144,7cyclictest3688-21Xorg08:06:591
340899142,6cyclictest0-21swapper/110:20:011
3408991411,2cyclictest0-21swapper/111:10:211
3408991410,2cyclictest0-21swapper/108:00:291
340899140,2cyclictest0-21swapper/112:17:011
340899140,13cyclictest0-21swapper/111:33:201
340899140,13cyclictest0-21swapper/110:46:401
340899140,13cyclictest0-21swapper/110:46:391
340899140,12cyclictest28972-21awk12:06:041
340899140,12cyclictest19855-21diskmemload09:35:131
340899140,12cyclictest0-21swapper/112:01:131
340899140,12cyclictest0-21swapper/110:34:441
340899140,12cyclictest0-21swapper/110:00:081
3407991411,2cyclictest31044-21kworker/u8:310:47:050
3407991411,2cyclictest31044-21kworker/u8:310:47:040
340799140,2cyclictest18143-21basename09:05:120
340799140,13cyclictest0-21swapper/007:25:120
341099138,3cyclictest0-21swapper/312:06:303
341099131,2cyclictest20980-21ssh10:17:163
3410991310,2cyclictest3764-21ssh11:06:123
3410991310,2cyclictest19922-21apt-get07:50:113
3410991310,2cyclictest0-21swapper/312:04:003
3410991310,2cyclictest0-21swapper/309:37:203
3410991310,2cyclictest0-21swapper/309:00:053
341099130,2cyclictest0-21swapper/311:12:473
341099130,2cyclictest0-21swapper/311:03:213
341099130,2cyclictest0-21swapper/310:32:493
341099130,12cyclictest0-21swapper/312:18:013
341099130,12cyclictest0-21swapper/310:44:103
341099130,12cyclictest0-21swapper/309:57:203
3409991310,2cyclictest8903-21kworker/u8:212:21:042
3409991310,2cyclictest31644-21kworker/u8:211:30:042
3409991310,2cyclictest21966-21kworker/u8:208:14:052
3409991310,2cyclictest21966-21kworker/u8:208:05:052
3409991310,2cyclictest10797-21kworker/u8:310:10:052
3409991310,2cyclictest0-21swapper/212:38:122
3409991310,2cyclictest0-21swapper/212:17:152
3409991310,2cyclictest0-21swapper/211:55:112
3409991310,2cyclictest0-21swapper/211:53:582
3409991310,2cyclictest0-21swapper/211:39:272
3409991310,2cyclictest0-21swapper/210:36:252
3409991310,2cyclictest0-21swapper/210:00:362
3409991310,2cyclictest0-21swapper/209:40:102
3409991310,2cyclictest0-21swapper/209:00:052
3409991310,2cyclictest0-21swapper/207:31:032
3409991310,2cyclictest0-21swapper/207:31:022
340999130,2cyclictest0-21swapper/210:52:042
340999130,2cyclictest0-21swapper/207:25:142
340999130,12cyclictest0-21swapper/208:16:042
340899138,3cyclictest9554-21ssh10:05:181
340899131,6cyclictest0-21swapper/111:15:001
340899131,3cyclictest0-21swapper/109:05:151
3408991310,2cyclictest0-21swapper/111:44:521
3408991310,2cyclictest0-21swapper/111:06:171
3408991310,2cyclictest0-21swapper/110:40:041
3408991310,2cyclictest0-21swapper/110:37:371
3408991310,2cyclictest0-21swapper/110:20:531
3408991310,2cyclictest0-21swapper/110:14:501
3408991310,2cyclictest0-21swapper/109:51:021
340899130,2cyclictest19855-21diskmemload11:48:461
340899130,2cyclictest0-21swapper/111:50:121
340899130,2cyclictest0-21swapper/111:25:181
340899130,2cyclictest0-21swapper/109:11:201
340899130,2cyclictest0-21swapper/107:25:141
340899130,12cyclictest0-21swapper/110:57:201
340899130,12cyclictest0-21swapper/110:25:301
340899130,12cyclictest0-21swapper/109:32:091
340899130,11cyclictest19855-21diskmemload10:51:151
340899130,11cyclictest0-21swapper/108:25:141
340899130,11cyclictest0-21swapper/108:15:391
3407991310,2cyclictest31644-21kworker/u8:211:32:050
3407991310,2cyclictest19855-21diskmemload12:31:020
3407991310,2cyclictest18055-21kworker/u8:109:41:050
3407991310,2cyclictest18055-21kworker/u8:109:24:050
3407991310,2cyclictest15838-21kworker/u8:011:07:040
3407991310,2cyclictest0-21swapper/012:21:390
3407991310,2cyclictest0-21swapper/012:15:110
3407991310,2cyclictest0-21swapper/007:50:120
340799130,2cyclictest0-21swapper/011:26:020
340799130,2cyclictest0-21swapper/009:30:040
341099129,2cyclictest0-21swapper/312:31:153
341099129,2cyclictest0-21swapper/311:46:473
341099129,2cyclictest0-21swapper/311:20:323
341099129,2cyclictest0-21swapper/309:23:003
341099129,2cyclictest0-21swapper/308:40:163
341099129,2cyclictest0-21swapper/308:20:173
341099129,2cyclictest0-21swapper/307:35:133
341099129,2cyclictest0-21swapper/307:30:153
341099129,2cyclictest0-21swapper/307:30:153
341099122,6cyclictest0-21swapper/308:31:043
341099122,6cyclictest0-21swapper/307:56:013
341099120,2cyclictest0-21swapper/312:36:103
341099120,2cyclictest0-21swapper/311:50:023
341099120,11cyclictest0-21swapper/312:27:533
341099120,11cyclictest0-21swapper/312:20:403
341099120,11cyclictest0-21swapper/310:57:393
341099120,11cyclictest0-21swapper/310:25:493
341099120,11cyclictest0-21swapper/310:00:283
341099120,11cyclictest0-21swapper/309:15:223
340999129,2cyclictest7655-21kworker/u8:008:40:052
340999129,2cyclictest31644-21kworker/u8:211:20:052
340999129,2cyclictest30763-21kworker/u8:108:22:052
340999129,2cyclictest301ktimersoftd/209:15:242
340999129,2cyclictest0-21swapper/212:30:152
340999129,2cyclictest0-21swapper/209:51:472
340999120,2cyclictest0-21swapper/207:56:032
340999120,11cyclictest22440-21ssh11:25:482
340999120,11cyclictest0-21swapper/210:24:492
340899129,2cyclictest0-21swapper/109:00:131
340899129,2cyclictest0-21swapper/107:40:011
340899122,7cyclictest0-21swapper/107:38:581
340899121,9cyclictest3836-21apt-get08:30:141
340899121,9cyclictest0-21swapper/111:35:151
340899121,9cyclictest0-21swapper/107:15:161
340899121,3cyclictest7784-21munin-node1
340899121,3cyclictest23730-21munin-run08:00:011
340899121,3cyclictest0-21swapper/107:50:591
340899120,2cyclictest0-21swapper/109:25:251
340899120,11cyclictest0-21swapper/107:30:121
340899120,11cyclictest0-21swapper/107:30:111
340899120,10cyclictest0-21swapper/108:41:001
340799129,2cyclictest7853-21kworker/u8:207:35:050
340799129,2cyclictest27076-21kworker/u8:009:17:050
340799129,2cyclictest26216-21kworker/u8:008:28:050
340799129,2cyclictest0-21swapper/012:35:180
340799120,9cyclictest0-21swapper/010:55:040
340799120,2cyclictest0-21swapper/012:13:190
340799120,11cyclictest0-21swapper/011:14:120
340799120,11cyclictest0-21swapper/008:16:020
340799120,11cyclictest0-21swapper/008:00:190
317302120,2sleep00-21swapper/011:35:220
64332110,2sleep00-21swapper/007:15:170
341099118,2cyclictest0-21swapper/307:45:133
341099118,2cyclictest0-21swapper/307:25:143
341099118,2cyclictest0-21swapper/307:20:133
341099111,7cyclictest0-21swapper/308:27:583
341099110,2cyclictest0-21swapper/308:51:333
341099110,2cyclictest0-21swapper/308:02:493
340999118,2cyclictest7853-21kworker/u8:207:41:052
340999118,2cyclictest3806-21kworker/u8:107:46:052
340999118,2cyclictest31537-21kworker/u8:007:10:022
340899111,8cyclictest32194-21munin-node1
340899111,8cyclictest0-21swapper/108:51:021
340899111,8cyclictest0-21swapper/108:45:181
340799118,2cyclictest5519-21kworker/u8:112:00:050
340799118,2cyclictest5519-21kworker/u8:111:51:050
340799118,2cyclictest3806-21kworker/u8:107:21:040
340799118,2cyclictest27076-21kworker/u8:009:25:050
340799118,2cyclictest21822-21ssh09:11:020
340799118,2cyclictest0-21swapper/011:57:220
340799118,2cyclictest0-21swapper/010:29:220
340799118,2cyclictest0-21swapper/009:38:230
340799118,2cyclictest0-21swapper/008:55:130
340799118,2cyclictest0-21swapper/008:45:140
340799118,2cyclictest0-21swapper/008:20:130
340799110,2cyclictest0-21swapper/010:32:410
340799110,10cyclictest0-21swapper/010:15:530
131192110,0sleep20-21swapper/208:51:012
341099102,7cyclictest0-21swapper/308:09:023
341099102,7cyclictest0-21swapper/307:42:593
341099102,6cyclictest0-21swapper/309:06:023
340999107,2cyclictest3806-21kworker/u8:108:03:042
340999107,2cyclictest1460-21kworker/u8:208:47:052
340899101,7cyclictest18361-21cut07:45:161
340799107,2cyclictest3806-21kworker/u8:107:47:050
340799107,2cyclictest3806-21kworker/u8:107:30:050
340799107,2cyclictest3806-21kworker/u8:107:30:040
340799100,9cyclictest0-21swapper/011:16:120
340799100,9cyclictest0-21swapper/010:05:110
340799100,2cyclictest0-21swapper/011:45:300
340799100,1cyclictest0-21swapper/010:04:230
173792100,2sleep00-21swapper/007:41:050
34109996,2cyclictest0-21swapper/308:15:123
34109996,2cyclictest0-21swapper/307:15:113
34109994,3cyclictest14697-21cut08:55:173
34099996,2cyclictest29-21rcuc/207:35:162
34099996,2cyclictest0-21swapper/208:55:162
34099994,3cyclictest2850-21rsyslogd09:10:002
34079996,2cyclictest0-21swapper/010:23:460
34079994,3cyclictest12549-21gltestperf08:50:150
34079990,8cyclictest19855-21diskmemload12:06:530
34079990,8cyclictest0-21swapper/008:11:130
34109983,3cyclictest28222-21aten2.4_r3power08:10:103
34099983,3cyclictest8019-21cpuspeed_turbos07:20:122
34079985,2cyclictest22454-21grep07:55:150
34079985,2cyclictest101ktimersoftd/007:10:120
34079980,7cyclictest0-21swapper/009:00:120
34079974,2cyclictest0-21swapper/008:30:130
34079973,3cyclictest6259-21df_abs08:35:140
34079970,6cyclictest0-21swapper/008:05:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional