You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-19 - 16:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Tue May 19, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2475799260,25cyclictest1239-21cron08:35:012
2475999250,24cyclictest18513-21diskmemload11:36:113
2475999250,1cyclictest10032-21ssh10:55:593
24757992520,2cyclictest0-21swapper/212:26:302
24752992523,1cyclictest0-21swapper/111:56:221
2475299252,22cyclictest607-21in:imuxsock11:15:001
2475299250,24cyclictest18513-21diskmemload10:26:351
2475299250,24cyclictest18513-21diskmemload09:50:471
2475299250,24cyclictest0-21swapper/111:15:311
24748992523,1cyclictest0-21swapper/010:22:560
24748992523,1cyclictest0-21swapper/010:17:320
2474899250,24cyclictest0-21swapper/011:55:370
2474899250,23cyclictest12935-21sh09:33:010
2474899250,1cyclictest606-21dbus-daemon08:55:000
24759992423,1cyclictest18555-21ssh09:37:573
24759992422,1cyclictest0-21swapper/312:35:243
2475999240,2cyclictest4266-21latency_hist12:15:003
2475999240,23cyclictest0-21swapper/311:57:333
24757992424,0cyclictest0-21swapper/211:42:072
24757992420,3cyclictest0-21swapper/211:57:192
2475799240,3cyclictest0-21swapper/211:11:012
2475799240,3cyclictest0-21swapper/210:13:282
2475799240,24cyclictest0-21swapper/210:09:122
2475799240,23cyclictest18513-21diskmemload09:55:182
2475799240,23cyclictest0-21swapper/212:30:382
2475799240,23cyclictest0-21swapper/212:03:372
2475799240,23cyclictest0-21swapper/211:47:312
24752992423,1cyclictest0-21swapper/109:41:371
24752992422,1cyclictest0-21swapper/111:49:341
2475299240,23cyclictest6095-21grep08:45:011
2475299240,23cyclictest14422-21perf07:55:011
2475299240,23cyclictest0-21swapper/112:20:141
2475299240,23cyclictest0-21swapper/112:10:401
2475299240,23cyclictest0-21swapper/110:15:071
24748992423,1cyclictest15251-21rm12:24:320
2474899242,1cyclictest4107-21sh09:26:030
2474899242,1cyclictest3868-21kworker/u8:011:48:030
2474899240,24cyclictest0-21swapper/011:33:500
2474899240,24cyclictest0-21swapper/009:23:590
2474899240,23cyclictest3802-21rm12:14:230
2474899240,23cyclictest18513-21diskmemload11:29:040
2474899240,22cyclictest0-21swapper/012:18:330
2474899240,1cyclictest0-21swapper/009:11:500
24759992323,0cyclictest18513-21diskmemload12:32:453
24759992323,0cyclictest18513-21diskmemload11:30:163
24759992323,0cyclictest18513-21diskmemload10:19:013
24759992323,0cyclictest0-21swapper/312:09:393
24759992323,0cyclictest0-21swapper/311:06:523
24759992323,0cyclictest0-21swapper/310:45:453
24759992323,0cyclictest0-21swapper/310:43:113
24759992323,0cyclictest0-21swapper/310:38:013
24759992323,0cyclictest0-21swapper/309:24:373
2475999230,23cyclictest0-21swapper/312:25:133
2475999230,23cyclictest0-21swapper/309:45:503
2475999230,23cyclictest0-21swapper/309:27:043
2475999230,23cyclictest0-21swapper/309:10:273
2475999230,22cyclictest8341-21ssh11:50:333
2475999230,22cyclictest3471-21ssh11:46:413
2475999230,22cyclictest26754-21ssh11:10:233
2475999230,22cyclictest17098-21ssh10:05:563
2475999230,22cyclictest11306-21turbostat11:25:003
2475999230,0cyclictest18513-21diskmemload10:03:533
2475999230,0cyclictest0-21swapper/312:20:203
24757992323,0cyclictest0-21swapper/211:39:352
24757992323,0cyclictest0-21swapper/211:17:272
24757992323,0cyclictest0-21swapper/210:35:552
24757992323,0cyclictest0-21swapper/209:31:172
24757992323,0cyclictest0-21swapper/209:10:032
24757992321,1cyclictest0-21swapper/209:17:312
2475799230,23cyclictest5932-1kworker/u9:010:56:412
2475799230,23cyclictest0-21swapper/211:50:352
2475799230,22cyclictest21751-21ssh09:41:522
2475799230,1cyclictest18513-21diskmemload09:47:592
2475799230,0cyclictest18513-21diskmemload12:21:132
2475799230,0cyclictest0-21swapper/212:16:092
2475799230,0cyclictest0-21swapper/212:05:012
2475799230,0cyclictest0-21swapper/211:20:392
2475799230,0cyclictest0-21swapper/211:00:042
24752992323,0cyclictest18513-21diskmemload09:35:041
24752992323,0cyclictest0-21swapper/111:38:391
24752992323,0cyclictest0-21swapper/111:05:301
24752992323,0cyclictest0-21swapper/110:52:531
24752992321,1cyclictest0-21swapper/110:45:181
24752992321,1cyclictest0-21swapper/110:03:471
24752992321,1cyclictest0-21swapper/109:25:061
24752992320,2cyclictest29804-21ssh12:08:291
2475299230,23cyclictest0-21swapper/112:00:481
2475299230,23cyclictest0-21swapper/111:50:181
2475299230,23cyclictest0-21swapper/111:28:321
2475299230,23cyclictest0-21swapper/109:18:461
2475299230,22cyclictest8157-21munin-node12:34:301
2475299230,22cyclictest7471-21ssh12:17:371
2475299230,22cyclictest0-21swapper/111:40:151
2475299230,22cyclictest0-21swapper/110:31:371
2475299230,22cyclictest0-21swapper/110:05:481
2475299230,1cyclictest16689-21sh11:02:161
2475299230,0cyclictest18513-21diskmemload10:14:101
2475299230,0cyclictest0-21swapper/109:55:511
24748992323,0cyclictest18513-21diskmemload10:31:320
24748992323,0cyclictest18513-21diskmemload09:57:290
24748992323,0cyclictest0-21swapper/011:51:090
24748992323,0cyclictest0-21swapper/010:55:590
24748992323,0cyclictest0-21swapper/009:17:480
24748992322,1cyclictest0-21swapper/010:11:110
24748992322,1cyclictest0-21swapper/009:40:390
24748992321,1cyclictest313-21systemd-journal12:05:000
24748992321,1cyclictest23525-21apt-get12:32:350
24748992321,1cyclictest2073-21ssh11:17:330
24748992321,1cyclictest0-21swapper/010:40:100
2474899231,1cyclictest62550irq/127-eno111:37:210
2474899231,1cyclictest20108-21cron09:40:000
2474899230,23cyclictest18513-21diskmemload11:10:360
2474899230,23cyclictest0-21swapper/012:05:170
2474899230,23cyclictest0-21swapper/010:51:520
2474899230,23cyclictest0-21swapper/010:49:380
2474899230,22cyclictest398-21ssh09:51:320
2474899230,22cyclictest27878-21ssh12:35:470
2474899230,1cyclictest20826-21diskmemload10:37:330
2474899230,1cyclictest18549-21munin-run09:10:000
2474899230,0cyclictest0-21swapper/012:25:260
2474899230,0cyclictest0-21swapper/011:40:020
2474899230,0cyclictest0-21swapper/011:05:240
2474899230,0cyclictest0-21swapper/010:05:140
24759992222,0cyclictest0-21swapper/312:03:173
24759992222,0cyclictest0-21swapper/311:27:583
24759992221,0cyclictest807-21apt-get10:20:023
24759992220,1cyclictest13402-21sh10:30:423
2475999220,22cyclictest25034-21ssh10:12:373
2475999220,22cyclictest0-21swapper/312:17:373
2475999220,22cyclictest0-21swapper/311:40:083
2475999220,22cyclictest0-21swapper/309:33:153
2475999220,21cyclictest18513-21diskmemload09:55:053
2475999220,21cyclictest18513-21diskmemload09:52:073
2475999220,21cyclictest15406-21rm11:00:273
2475999220,1cyclictest28903-21grep08:25:013
2475999220,0cyclictest0-21swapper/310:26:353
2475999220,0cyclictest0-21swapper/309:15:023
24757992222,0cyclictest0-21swapper/211:30:412
24757992222,0cyclictest0-21swapper/210:26:452
24757992222,0cyclictest0-21swapper/210:20:002
24757992220,2cyclictest16000-21sh09:36:512
24757992220,1cyclictest20913-21ssh11:05:112
24757992220,1cyclictest10705-21ssh10:00:042
24757992220,1cyclictest0-21swapper/210:45:272
24757992220,1cyclictest0-21swapper/210:30:062
2475799220,22cyclictest0-21swapper/212:11:152
2475799220,21cyclictest6088-21apt-get08:45:022
2475799220,21cyclictest606-21dbus-daemon09:05:002
2475799220,21cyclictest12914-21ssh11:26:522
2475799220,21cyclictest10080-21apt-get07:47:322
2475799220,21cyclictest0-21swapper/212:35:432
2475799220,1cyclictest4641-21ssh10:51:222
2475799220,1cyclictest24695-21apt-get10:40:022
2475799220,1cyclictest0-21swapper/209:20:262
2475799220,0cyclictest0-21swapper/209:50:152
24752992222,0cyclictest18513-21diskmemload12:35:361
24752992222,0cyclictest0-21swapper/111:31:541
24752992221,1cyclictest32386-21apt-get07:27:311
2475299220,21cyclictest7128-21ssh11:21:541
2475299220,21cyclictest0-21swapper/112:25:211
2475299220,21cyclictest0-21swapper/110:55:121
2475299220,21cyclictest0-21swapper/110:40:101
2475299220,21cyclictest0-21swapper/110:35:071
2475299220,21cyclictest0-21swapper/110:22:381
2475299220,21cyclictest0-21swapper/108:12:321
2475299220,1cyclictest0-21swapper/109:21:211
2475299220,1cyclictest0-21swapper/109:11:131
2475299220,0cyclictest18513-21diskmemload09:30:141
24748992221,1cyclictest0-21swapper/009:48:250
2474899220,22cyclictest0-21swapper/010:25:030
2474899220,21cyclictest0-21swapper/008:42:310
2474899220,1cyclictest7235-21idleruntime-cro07:40:010
2474899220,1cyclictest0-21swapper/011:20:270
2474899220,0cyclictest18513-21diskmemload11:01:430
2474899220,0cyclictest18513-21diskmemload10:01:160
24759992120,1cyclictest32309-21ssh11:15:193
24759992119,1cyclictest7239-21munin-run07:40:013
2475999210,21cyclictest18513-21diskmemload10:52:313
2475999210,21cyclictest0-21swapper/307:27:313
2475999210,20cyclictest2373-21apt-get07:32:323
2475999210,0cyclictest18513-21diskmemload09:40:573
2475999210,0cyclictest0-21swapper/308:32:323
2475799210,20cyclictest18513-21diskmemload09:25:152
2475799210,1cyclictest1724-21apt-get08:37:322
2475799210,0cyclictest7686-21apt-get07:42:322
2475799210,0cyclictest0-21swapper/210:20:202
24752992121,0cyclictest0-21swapper/107:42:321
24752992120,0cyclictest0-21swapper/108:07:331
24752992119,1cyclictest31296-21munin-run08:30:011
2475299210,0cyclictest0-21swapper/109:02:321
24748992121,0cyclictest0-21swapper/008:32:320
24748992120,0cyclictest0-21swapper/008:27:310
2474899210,0cyclictest0-21swapper/008:17:320
24759992020,0cyclictest0-21swapper/308:47:323
24759992020,0cyclictest0-21swapper/308:42:313
24759992020,0cyclictest0-21swapper/307:42:313
2475999200,20cyclictest0-21swapper/308:07:333
2475999200,0cyclictest27576-21apt-get07:17:323
24757992020,0cyclictest0-21swapper/207:27:312
24757992020,0cyclictest0-21swapper/207:22:322
24757992019,0cyclictest0-21swapper/207:57:322
24757992017,2cyclictest11278-21latency_hist08:55:002
24752992020,0cyclictest0-21swapper/108:52:341
24752992019,0cyclictest0-21swapper/107:32:311
24752992018,1cyclictest26500-21perf08:20:001
2475299200,0cyclictest0-21swapper/108:47:321
24748992018,1cyclictest19735-21apt-get08:07:330
2474899200,19cyclictest0-21swapper/009:02:320
24759991919,0cyclictest0-21swapper/309:07:323
24759991919,0cyclictest0-21swapper/308:27:313
24759991919,0cyclictest0-21swapper/307:52:313
24759991919,0cyclictest0-21swapper/307:12:323
24757991919,0cyclictest25180-21apt-get07:12:332
24757991919,0cyclictest11729-21apt-get08:57:332
24757991919,0cyclictest0-21swapper/208:12:322
24757991919,0cyclictest0-21swapper/207:37:292
24757991917,1cyclictest28907-21munin-run08:25:012
24752991919,0cyclictest0-21swapper/107:37:291
24752991918,0cyclictest0-21swapper/108:57:331
24748991919,0cyclictest0-21swapper/008:45:020
24748991919,0cyclictest0-21swapper/007:27:310
24748991919,0cyclictest0-21swapper/007:17:320
24748991919,0cyclictest0-21swapper/007:12:330
24759991818,0cyclictest0-21swapper/307:47:323
24759991816,1cyclictest0-21swapper/308:15:003
24757991818,0cyclictest0-21swapper/208:17:322
24757991818,0cyclictest0-21swapper/207:32:312
24757991816,1cyclictest0-21swapper/209:10:002
24752991818,0cyclictest0-21swapper/108:02:301
24752991816,1cyclictest0-21swapper/107:50:011
2475299180,0cyclictest0-21swapper/108:22:331
24748991818,0cyclictest0-21swapper/008:37:320
24748991818,0cyclictest0-21swapper/007:32:320
24759991716,0cyclictest17285-21apt-get08:02:303
2475799171,7cyclictest606-21dbus-daemon07:55:012
24752991717,0cyclictest16538-21apt-get09:07:321
24752991717,0cyclictest0-21swapper/107:17:321
24748991717,0cyclictest0-21swapper/007:42:310
24759991615,0cyclictest0-21swapper/307:57:313
24757991614,1cyclictest0-21swapper/208:26:052
24752991616,0cyclictest0-21swapper/107:22:321
2475299160,16cyclictest0-21swapper/108:37:321
2474899163,12cyclictest8157-21munin-node08:22:460
24748991616,0cyclictest0-21swapper/007:52:310
24748991615,1cyclictest14871-21apt-get07:57:310
24748991615,0cyclictest0-21swapper/007:47:320
2475999155,10cyclictest8157-21munin-node09:00:263
24759991515,0cyclictest29995-21apt-get07:22:323
24759991515,0cyclictest0-21swapper/308:57:333
24759991513,1cyclictest26499-21grep08:20:003
24752991514,0cyclictest0-21swapper/107:57:311
24752991513,1cyclictest0-21swapper/108:30:161
2475299150,14cyclictest26083-21memory07:12:371
2474899151,0cyclictest0-21swapper/008:01:140
2475999140,0cyclictest0-21swapper/308:35:493
2475799140,14cyclictest0-21swapper/208:40:042
2475799140,14cyclictest0-21swapper/208:06:292
2475799140,0cyclictest0-21swapper/208:00:312
24748991414,0cyclictest0-21swapper/008:58:030
24748991414,0cyclictest0-21swapper/007:20:150
2474899140,14cyclictest0-21swapper/008:10:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional