You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-01 - 22:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Sat Aug 01, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31475992621,4cyclictest0-21swapper/209:49:152
3147799250,24cyclictest25214-21diskmemload12:20:363
3147599252,22cyclictest14629-21ssh10:56:082
3147599250,24cyclictest25214-21diskmemload11:32:072
3147599250,24cyclictest25214-21diskmemload09:28:002
3147599250,24cyclictest19945-21expr12:28:412
3147199250,24cyclictest25214-21diskmemload12:28:101
3146699250,24cyclictest0-21swapper/011:21:060
3146699250,24cyclictest0-21swapper/010:01:440
31477992423,1cyclictest0-21swapper/311:13:243
31477992422,1cyclictest0-21swapper/310:20:573
3147799240,24cyclictest0-21swapper/309:46:093
3147799240,23cyclictest25214-21diskmemload11:16:073
3147799240,23cyclictest20218-21tail11:58:483
3147799240,23cyclictest0-21swapper/312:06:423
3147799240,1cyclictest19355-21sh10:31:293
3147799240,0cyclictest0-21swapper/312:27:333
31475992423,1cyclictest16234-1kworker/u9:010:06:582
31475992422,1cyclictest25214-21diskmemload11:09:402
31475992422,1cyclictest0-21swapper/210:48:442
31475992422,1cyclictest0-21swapper/210:23:302
3147599240,23cyclictest0-21swapper/210:28:422
3147599240,1cyclictest0-21swapper/212:17:042
3147599240,1cyclictest0-21swapper/211:27:002
31471992424,0cyclictest0-21swapper/112:18:351
31471992423,1cyclictest883-21ssh12:10:411
3147199241,22cyclictest29324-21sh09:43:191
3147199240,24cyclictest25214-21diskmemload10:16:351
3147199240,24cyclictest0-21swapper/110:31:131
31466992423,1cyclictest0-21swapper/009:35:310
31466992422,1cyclictest31981-21rm11:40:010
31466992422,1cyclictest15980-21sh09:59:060
31466992421,2cyclictest17025-21ssh09:31:460
31466992421,2cyclictest16316-21sh11:26:210
31466992421,2cyclictest0-21swapper/010:30:370
3146699240,24cyclictest0-21swapper/012:23:450
3146699240,24cyclictest0-21swapper/012:08:250
3146699240,24cyclictest0-21swapper/009:23:260
3146699240,23cyclictest30682-21apt-get12:38:400
3146699240,23cyclictest0-21swapper/010:40:490
3146699240,1cyclictest7120-21irqstats11:18:420
3146699240,0cyclictest0-21swapper/011:52:490
31477992323,0cyclictest25214-21diskmemload09:20:193
31477992323,0cyclictest0-21swapper/312:36:303
31477992323,0cyclictest0-21swapper/312:00:033
31477992323,0cyclictest0-21swapper/311:54:233
31477992323,0cyclictest0-21swapper/310:29:083
31477992323,0cyclictest0-21swapper/310:19:493
31477992323,0cyclictest0-21swapper/309:26:353
31477992323,0cyclictest0-21swapper/309:10:023
31477992322,1cyclictest22012-21apt-get11:03:383
31477992322,0cyclictest0-21swapper/312:16:473
31477992321,1cyclictest0-21swapper/310:01:003
3147799230,2cyclictest6108-21rm11:46:223
3147799230,23cyclictest0-21swapper/309:35:413
3147799230,22cyclictest8767-21sh09:53:403
3147799230,22cyclictest4372-21dump-pmu-power09:20:013
3147799230,22cyclictest0-21swapper/311:20:293
3147799230,21cyclictest0-21swapper/311:33:093
3147799230,0cyclictest0-21swapper/310:55:313
3147799230,0cyclictest0-21swapper/310:51:103
3147799230,0cyclictest0-21swapper/309:30:493
31475992323,0cyclictest0-21swapper/212:35:382
31475992323,0cyclictest0-21swapper/212:21:002
31475992323,0cyclictest0-21swapper/211:46:212
31475992322,0cyclictest0-21swapper/211:10:382
31475992321,1cyclictest24087-21sh10:35:172
31475992321,1cyclictest0-21swapper/210:12:002
31475992321,1cyclictest0-21swapper/209:24:022
31475992320,2cyclictest510-21sh12:10:152
31475992320,2cyclictest27017-21ssh09:40:072
3147599230,23cyclictest0-21swapper/211:50:442
3147599230,23cyclictest0-21swapper/209:52:292
3147599230,22cyclictest4890-21sh11:45:002
3147599230,22cyclictest26670-21rm09:11:292
3147599230,22cyclictest25214-21diskmemload11:22:292
3147599230,22cyclictest21438-21sh09:35:112
3147599230,22cyclictest1625-21ssh10:15:242
3147599230,22cyclictest1226-21ssh09:18:012
3147599230,22cyclictest0-21swapper/210:32:132
3147599230,22cyclictest0-21swapper/209:56:322
3147599230,0cyclictest25214-21diskmemload10:50:552
31471992323,0cyclictest25214-21diskmemload11:29:171
31471992323,0cyclictest14502-21ssh10:55:581
31471992323,0cyclictest0-21swapper/112:20:161
31471992323,0cyclictest0-21swapper/111:33:391
31471992323,0cyclictest0-21swapper/111:02:011
31471992323,0cyclictest0-21swapper/110:44:101
31471992323,0cyclictest0-21swapper/109:34:561
31471992322,1cyclictest27156-21ssh11:08:071
31471992322,1cyclictest11387-21ssh11:22:521
31471992322,1cyclictest0-21swapper/109:51:521
3147199230,23cyclictest25214-21diskmemload11:12:211
3147199230,23cyclictest0-21swapper/110:47:281
3147199230,23cyclictest0-21swapper/110:05:551
3147199230,23cyclictest0-21swapper/109:25:371
3147199230,23cyclictest0-21swapper/109:23:591
3147199230,22cyclictest783-21snmpd09:10:331
3147199230,22cyclictest14800-21sh10:28:261
3147199230,0cyclictest25214-21diskmemload11:47:501
3147199230,0cyclictest0-21swapper/109:57:121
31466992323,0cyclictest0-21swapper/012:31:090
31466992321,1cyclictest3949-21ssh10:46:450
31466992321,1cyclictest0-21swapper/009:50:560
31466992321,1cyclictest0-21swapper/009:45:420
31466992320,2cyclictest30258-21unixbench_singl09:13:480
31466992320,2cyclictest28298-21ssh10:10:160
3146699231,1cyclictest21231-21ssh11:30:300
3146699230,22cyclictest833-21sleep08:20:000
3146699230,22cyclictest32262-21ssh11:40:190
3146699230,22cyclictest31096-21sh11:10:560
3146699230,22cyclictest27364-21sh09:40:430
3146699230,22cyclictest25214-21diskmemload12:11:530
3146699230,22cyclictest20733-21ssh11:01:530
3146699230,0cyclictest25214-21diskmemload09:16:050
3146699230,0cyclictest0-21swapper/010:56:550
31477992222,0cyclictest25214-21diskmemload10:36:433
31477992222,0cyclictest0-21swapper/311:27:003
31477992221,1cyclictest2003-21apt-get07:18:373
31477992220,1cyclictest22810-21sh10:05:283
3147799220,22cyclictest0-21swapper/311:35:173
3147799220,22cyclictest0-21swapper/309:58:153
3147799220,21cyclictest25214-21diskmemload10:11:233
3147799220,21cyclictest16170-21apt-get08:53:383
3147799220,21cyclictest0-21swapper/312:31:163
3147799220,21cyclictest0-21swapper/312:11:053
3147799220,21cyclictest0-21swapper/310:45:483
3147799220,21cyclictest0-21swapper/310:40:093
3147799220,1cyclictest9084-21munin-run07:30:003
3147799220,1cyclictest0-21swapper/311:41:093
3147799220,1cyclictest0-21swapper/311:05:383
3147799220,0cyclictest0-21swapper/309:43:113
31475992222,0cyclictest0-21swapper/211:35:392
31475992222,0cyclictest0-21swapper/209:30:512
31475992220,1cyclictest6289-21perf07:25:002
31475992220,1cyclictest25214-21diskmemload11:15:302
31475992220,1cyclictest23572-21cron08:00:002
31475992220,1cyclictest23042-21ssh12:01:482
31475992220,1cyclictest19790-21sh11:00:332
31475992220,1cyclictest0-21swapper/212:31:382
31475992220,1cyclictest0-21swapper/211:55:242
31475992220,1cyclictest0-21swapper/210:40:362
31475992219,2cyclictest30687-21wc12:08:432
3147599220,21cyclictest0-21swapper/210:00:052
31471992222,0cyclictest25214-21diskmemload09:16:421
31471992222,0cyclictest0-21swapper/112:07:271
31471992222,0cyclictest0-21swapper/112:02:521
31471992222,0cyclictest0-21swapper/110:38:271
31471992222,0cyclictest0-21swapper/110:21:581
3147199220,22cyclictest25214-21diskmemload11:15:071
3147199220,21cyclictest446-21ssh11:41:181
3147199220,21cyclictest25214-21diskmemload10:10:371
3147199220,21cyclictest21444-21ssh09:35:121
3147199220,21cyclictest13681-21/usr/sbin/munin11:53:401
3147199220,21cyclictest0-21swapper/107:35:011
3147199220,1cyclictest25218-21sleep09:10:011
3147199220,1cyclictest25218-21sleep09:10:011
3147199220,1cyclictest0-21swapper/110:51:451
31466992221,1cyclictest21810-21ssh12:00:020
31466992221,1cyclictest0-21swapper/010:05:580
31466992220,1cyclictest8624-21ssh10:50:370
31466992220,1cyclictest0-21swapper/010:15:200
31466992219,2cyclictest10821-21sh08:40:010
3146699220,22cyclictest0-21swapper/010:36:140
3146699220,21cyclictest0-21swapper/010:27:100
3146699220,21cyclictest0-21swapper/009:25:430
3146699220,21cyclictest0-21swapper/007:13:380
3146699220,1cyclictest26521-21apt-get08:08:390
3146699220,1cyclictest26085-21ssh11:06:360
3146699220,1cyclictest16461-21ssh11:55:230
3146699220,1cyclictest0-21swapper/012:25:070
3146699220,0cyclictest0-21swapper/011:46:110
3147799210,20cyclictest0-21swapper/308:28:393
3147799210,1cyclictest13962-21sh07:40:013
31475992119,2cyclictest0-21swapper/209:08:382
31475992119,2cyclictest0-21swapper/209:08:382
31475992119,1cyclictest14529-21apt-get07:43:412
31475992119,1cyclictest0-21swapper/208:38:382
31475992119,1cyclictest0-21swapper/207:55:002
3147599210,21cyclictest0-21swapper/207:48:382
3147599210,0cyclictest9613-21apt-get07:33:392
31471992121,0cyclictest6573-21apt-get08:33:391
31471992121,0cyclictest0-21swapper/111:35:181
31471992120,1cyclictest792-21rm09:45:571
31471992120,1cyclictest28383-21turbostat08:10:001
31471992119,1cyclictest0-21swapper/108:05:001
3147199210,21cyclictest0-21swapper/112:36:411
3147199210,21cyclictest0-21swapper/111:55:221
3147199210,0cyclictest0-21swapper/110:00:021
31466992120,0cyclictest12111-21apt-get07:38:390
3146699210,21cyclictest0-21swapper/010:20:210
3146699210,20cyclictest23375-21apt-get09:08:380
3146699210,20cyclictest23375-21apt-get09:08:380
3146699210,20cyclictest0-21swapper/007:28:380
3146699210,0cyclictest0-21swapper/008:28:390
31477992019,0cyclictest0-21swapper/307:43:423
3147799200,0cyclictest0-21swapper/308:23:373
3147799200,0cyclictest0-21swapper/307:25:003
31475992020,0cyclictest11382-21apt-get08:43:392
31475992020,0cyclictest0-21swapper/208:53:382
31475992020,0cyclictest0-21swapper/208:23:372
31475992020,0cyclictest0-21swapper/208:18:382
31475992019,1cyclictest0-21swapper/208:25:022
31471992020,0cyclictest0-21swapper/108:58:391
31471992020,0cyclictest0-21swapper/108:25:021
3147199200,20cyclictest0-21swapper/107:38:391
31466992020,0cyclictest0-21swapper/008:53:390
31466992018,1cyclictest21709-21apt-get07:58:370
31477991919,0cyclictest0-21swapper/307:33:393
31477991918,1cyclictest0-21swapper/307:48:383
3147799190,18cyclictest0-21swapper/308:38:383
31475991918,1cyclictest0-21swapper/209:03:402
31471991919,0cyclictest0-21swapper/108:43:391
31471991919,0cyclictest0-21swapper/107:18:371
31471991917,1cyclictest0-21swapper/107:30:001
31466991919,0cyclictest0-21swapper/008:33:390
31466991919,0cyclictest0-21swapper/007:23:370
31466991917,1cyclictest11465-21dump-pmu-power07:35:010
31477991816,1cyclictest313-21systemd-journal08:00:003
31475991817,0cyclictest0-21swapper/208:58:402
3147599180,0cyclictest0-21swapper/207:38:392
31471991818,0cyclictest0-21swapper/108:53:391
31471991818,0cyclictest0-21swapper/108:48:381
31471991818,0cyclictest0-21swapper/108:13:391
31471991818,0cyclictest0-21swapper/107:58:371
31466991818,0cyclictest0-21swapper/008:43:390
31466991817,0cyclictest0-21swapper/007:18:370
31477991717,0cyclictest0-21swapper/309:03:403
31477991717,0cyclictest0-21swapper/308:18:383
3147799170,4cyclictest0-21swapper/308:43:393
3147799170,0cyclictest0-21swapper/308:03:403
31471991717,0cyclictest0-21swapper/108:18:381
31466991716,0cyclictest0-21swapper/008:03:400
3146699170,14cyclictest0-21swapper/007:43:320
31477991615,0cyclictest0-21swapper/309:08:383
31477991615,0cyclictest0-21swapper/309:08:383
3147799160,9cyclictest18565-21apt-get08:58:403
31475991616,0cyclictest31965-21apt-get07:13:382
31475991616,0cyclictest0-21swapper/207:25:022
3147599160,8cyclictest0-21swapper/208:03:402
31471991614,1cyclictest0-21swapper/107:48:421
31466991614,1cyclictest0-21swapper/008:23:410
3146699160,15cyclictest19713-21cat07:53:400
31477991515,0cyclictest0-21swapper/307:53:403
3147799150,14cyclictest0-21swapper/308:12:233
31471991515,0cyclictest6282-21apt-get07:25:001
31471991515,0cyclictest1365-21apt-get08:23:371
31471991515,0cyclictest0-21swapper/107:13:381
31471991513,1cyclictest16396-21munin-run07:45:011
31466991515,0cyclictest0-21swapper/008:58:400
3147799140,14cyclictest0-21swapper/308:46:173
3147799140,14cyclictest0-21swapper/308:05:553
3147799140,0cyclictest0-21swapper/308:30:333
3147799140,0cyclictest0-21swapper/307:10:133
3147599140,14cyclictest0-21swapper/208:47:462
3147599140,14cyclictest0-21swapper/208:33:242
3147599140,14cyclictest0-21swapper/208:10:102
3147599140,14cyclictest0-21swapper/208:06:272
3147599140,14cyclictest0-21swapper/207:15:072
3147199140,0cyclictest0-21swapper/109:01:231
3147199140,0cyclictest0-21swapper/108:35:291
31466991414,0cyclictest0-21swapper/008:46:580
31466991414,0cyclictest0-21swapper/008:10:040
3146699140,14cyclictest0-21swapper/009:00:180
3146699140,0cyclictest0-21swapper/007:45:250
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional