You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-20 - 19:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Mon Jul 20, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29193992523,1cyclictest0-21swapper/312:30:183
29193992522,2cyclictest0-21swapper/310:26:583
2919399250,24cyclictest9398-21sh10:22:453
2919399250,24cyclictest31348-21apt-get09:17:403
29190992521,3cyclictest21438-21apt-get11:02:392
29190992520,4cyclictest23271-21diskmemload09:47:202
2918599250,1cyclictest1747-21ssh10:16:381
2918299250,24cyclictest6082-21ntp_states09:22:450
2918299250,1cyclictest0-21swapper/011:18:160
29193992423,1cyclictest6536-21apt-get11:17:413
29193992423,1cyclictest12508-21apt-get07:42:383
29193992422,2cyclictest30816-21apt-get10:42:403
2919399242,21cyclictest7310-21idleruntime-cro12:15:013
2919399240,23cyclictest25914-21ssh09:40:203
2919399240,23cyclictest0-21swapper/311:06:073
2919399240,0cyclictest0-21swapper/309:25:083
2919099242,21cyclictest23271-21diskmemload10:27:452
29190992422,1cyclictest0-21swapper/212:01:482
29190992422,1cyclictest0-21swapper/212:01:482
2919099242,1cyclictest18045-21sh12:24:202
29190992419,4cyclictest0-21swapper/210:48:452
2919099240,23cyclictest29563-21ssh11:08:412
2919099240,23cyclictest0-21swapper/211:47:272
2919099240,23cyclictest0-21swapper/211:27:392
2919099240,23cyclictest0-21swapper/209:12:422
2918599240,23cyclictest2462-21ssh12:10:481
2918599240,21cyclictest0-21swapper/110:35:011
2918599240,0cyclictest0-21swapper/110:23:461
2918599240,0cyclictest0-21swapper/110:00:301
2918599240,0cyclictest0-21swapper/109:40:441
29182992424,0cyclictest0-21swapper/009:14:220
29182992423,1cyclictest12803-21diskmemload11:51:290
29182992423,1cyclictest0-21swapper/011:57:040
2918299242,1cyclictest62550irq/127-eno111:02:430
29182992421,2cyclictest23101-21sh12:28:360
2918299240,24cyclictest23271-21diskmemload11:21:120
2918299240,23cyclictest7901-21ssh10:50:130
2918299240,23cyclictest0-21swapper/012:13:000
2918299240,23cyclictest0-21swapper/011:27:390
2918299240,1cyclictest62550irq/127-eno110:18:000
2918299240,0cyclictest23271-21diskmemload10:35:200
29193992323,0cyclictest23271-21diskmemload10:06:383
29193992323,0cyclictest0-21swapper/312:39:163
29193992323,0cyclictest0-21swapper/311:37:463
29193992323,0cyclictest0-21swapper/309:58:133
29193992323,0cyclictest0-21swapper/309:50:223
29193992321,1cyclictest0-21swapper/312:05:513
29193992321,1cyclictest0-21swapper/309:32:383
29193992321,1cyclictest0-21swapper/309:23:033
29193992320,2cyclictest21640-21sh11:30:093
2919399230,23cyclictest0-21swapper/312:01:563
2919399230,23cyclictest0-21swapper/312:01:563
2919399230,22cyclictest4657-21fschecks_time10:47:413
2919399230,22cyclictest4336-21apt07:25:013
2919399230,22cyclictest23619-21timerwakeupswit09:37:493
2919399230,22cyclictest18947-21sh12:25:173
2919399230,22cyclictest18549-21sh11:56:383
2919399230,22cyclictest1752-21rm11:41:493
2919399230,22cyclictest16477-21sh10:00:413
2919399230,22cyclictest14815-21ssh12:22:183
2919399230,22cyclictest0-21swapper/311:22:453
2919399230,0cyclictest0-21swapper/312:19:383
2919399230,0cyclictest0-21swapper/310:50:183
29190992323,0cyclictest0-21swapper/211:17:222
29190992323,0cyclictest0-21swapper/210:52:522
29190992323,0cyclictest0-21swapper/210:41:082
29190992323,0cyclictest0-21swapper/209:25:462
29190992321,1cyclictest3288-21awk12:40:002
29190992321,1cyclictest0-21swapper/212:05:332
29190992321,1cyclictest0-21swapper/211:33:172
29190992320,2cyclictest4334-21/usr/sbin/munin12:12:412
2919099230,2cyclictest11589-21sh11:21:582
2919099230,23cyclictest0-21swapper/212:26:552
2919099230,23cyclictest0-21swapper/211:10:282
2919099230,22cyclictest28400-21ssh10:39:442
2919099230,22cyclictest23271-21diskmemload11:50:242
2919099230,22cyclictest22373-21rm10:06:002
2919099230,22cyclictest18136-21cpuspeed_turbos10:02:402
2919099230,22cyclictest10909-21ssh10:24:032
2919099230,22cyclictest0-21swapper/210:55:282
2919099230,22cyclictest0-21swapper/210:12:432
29185992323,0cyclictest0-21swapper/112:01:321
29185992323,0cyclictest0-21swapper/112:01:321
29185992323,0cyclictest0-21swapper/111:51:021
29185992323,0cyclictest0-21swapper/111:17:051
29185992323,0cyclictest0-21swapper/109:47:081
29185992322,1cyclictest20727-1kworker/u9:111:55:151
29185992321,1cyclictest25243-21ssh09:12:071
29185992321,1cyclictest13145-21ssh10:54:581
29185992321,1cyclictest0-21swapper/112:07:401
2918599230,2cyclictest29336-21ssh11:08:131
2918599230,2cyclictest27156-21latency_hist11:35:001
2918599230,23cyclictest0-21swapper/111:04:501
2918599230,23cyclictest0-21swapper/109:55:521
2918599230,22cyclictest8334-21unixbench_singl09:52:481
2918599230,22cyclictest30555-21sh12:35:281
2918599230,22cyclictest29212-21ssh10:40:321
2918599230,22cyclictest2876-21taskset11:13:061
2918599230,22cyclictest11453-21sh12:18:001
2918599230,22cyclictest0-21swapper/109:24:541
2918599230,0cyclictest0-21swapper/111:42:061
2918599230,0cyclictest0-21swapper/111:27:311
2918599230,0cyclictest0-21swapper/110:36:121
2918599230,0cyclictest0-21swapper/110:25:371
2918599230,0cyclictest0-21swapper/109:35:191
2918599230,0cyclictest0-21swapper/109:30:361
29182992323,0cyclictest23271-21diskmemload09:37:420
29182992323,0cyclictest0-21swapper/010:27:340
29182992323,0cyclictest0-21swapper/010:05:130
29182992322,1cyclictest0-21swapper/011:34:440
29182992321,1cyclictest0-21swapper/010:40:420
29182992321,1cyclictest0-21swapper/010:02:000
2918299230,23cyclictest31264-21rm09:17:330
2918299230,23cyclictest0-21swapper/010:14:040
2918299230,23cyclictest0-21swapper/009:51:590
2918299230,23cyclictest0-21swapper/009:28:370
2918299230,22cyclictest25647-21ssh12:31:410
2918299230,22cyclictest23271-21diskmemload09:42:400
2918299230,0cyclictest0-21swapper/012:19:430
2918299230,0cyclictest0-21swapper/012:05:500
2918299230,0cyclictest0-21swapper/011:40:330
2918299230,0cyclictest0-21swapper/011:08:590
29193992220,1cyclictest16851-21munin-run07:50:003
29193992220,1cyclictest0-21swapper/310:10:043
2919399220,22cyclictest0-21swapper/308:15:013
2919399220,21cyclictest947-21ssh10:15:393
2919399220,21cyclictest32238-21ssh09:46:073
2919399220,21cyclictest23271-21diskmemload10:33:483
2919399220,21cyclictest10087-21apt-get07:37:373
2919399220,21cyclictest0-21swapper/311:10:023
2919399220,21cyclictest0-21swapper/309:10:173
2919399220,21cyclictest0-21swapper/307:17:403
2919399220,1cyclictest0-21swapper/311:00:013
2919399220,1cyclictest0-21swapper/310:35:323
2919399220,0cyclictest0-21swapper/311:53:073
2919399220,0cyclictest0-21swapper/311:25:093
29190992222,0cyclictest0-21swapper/212:15:172
29190992222,0cyclictest0-21swapper/211:56:532
29190992220,1cyclictest19696-21apt-get07:57:392
29190992220,1cyclictest0-21swapper/212:31:012
29190992220,1cyclictest0-21swapper/210:34:202
2919099220,21cyclictest4796-21apt-get07:27:362
2919099220,21cyclictest3524-21sh09:20:372
2919099220,21cyclictest31774-21apt-get08:22:382
2919099220,21cyclictest23271-21diskmemload09:42:542
2919099220,21cyclictest16105-21munin-run08:55:012
2919099220,21cyclictest0-21swapper/211:40:352
2919099220,21cyclictest0-21swapper/209:35:282
2919099220,21cyclictest0-21swapper/209:30:092
2919099220,21cyclictest0-21swapper/207:47:392
2919099220,1cyclictest27230-21ssh11:35:042
2919099220,1cyclictest0-21swapper/210:15:562
2919099220,0cyclictest0-21swapper/209:50:132
29185992222,0cyclictest0-21swapper/110:55:171
29185992221,1cyclictest19003-21ssh12:25:201
29185992220,1cyclictest9499-21ssh09:26:101
29185992220,1cyclictest11310-21munin-run08:45:001
29185992220,1cyclictest0-21swapper/110:05:131
2918599220,21cyclictest6086-21ssh11:45:041
2918599220,21cyclictest29375-21ssh09:15:031
2918599220,21cyclictest2695-21ssh10:45:471
2918599220,21cyclictest21639-21sendmail-msp08:00:001
2918599220,21cyclictest19231-21grep07:55:001
2918599220,21cyclictest0-21swapper/112:30:341
2918599220,1cyclictest10299-21ssh11:20:121
2918599220,0cyclictest0-21swapper/110:10:511
29182992222,0cyclictest23271-21diskmemload11:10:430
29182992222,0cyclictest0-21swapper/010:58:230
29182992220,1cyclictest8848-21cron08:40:000
29182992220,1cyclictest31774-21apt-get08:22:390
29182992220,1cyclictest0-21swapper/011:36:270
29182992219,2cyclictest31319-21awk08:20:010
2918299220,22cyclictest0-21swapper/009:30:200
2918299220,21cyclictest6332-21ssh10:20:140
2918299220,21cyclictest6306-21ssh11:45:210
2918299220,1cyclictest3690-21grep08:30:000
2918299220,1cyclictest32436-21ssh09:46:290
2918299220,1cyclictest1792-21ssh12:38:060
2918299220,1cyclictest0-21swapper/012:20:570
29193992120,0cyclictest0-21swapper/308:37:393
2919399210,21cyclictest0-21swapper/310:55:173
2919399210,20cyclictest21634-21turbostat08:00:003
2919399210,20cyclictest0-21swapper/311:45:023
2919399210,20cyclictest0-21swapper/308:02:393
2919399210,20cyclictest0-21swapper/307:12:383
29190992121,0cyclictest18964-21apt-get09:02:392
29190992121,0cyclictest0-21swapper/209:17:342
2919099210,20cyclictest26901-21apt-get08:12:392
29185992121,0cyclictest0-21swapper/108:57:391
29185992121,0cyclictest0-21swapper/108:07:381
29185992121,0cyclictest0-21swapper/107:12:371
29185992119,1cyclictest7196-21apt-get07:32:381
29185992119,1cyclictest1293-21latency_hist08:25:001
2918599210,20cyclictest0-21swapper/111:35:051
2918599210,20cyclictest0-21swapper/107:47:391
2918599210,1cyclictest313-21systemd-journal07:45:001
2918599210,0cyclictest0-21swapper/107:22:381
29182992121,0cyclictest0-21swapper/008:02:390
29182992120,1cyclictest31546-21apt-get07:15:020
2918299210,20cyclictest0-21swapper/008:42:390
2918299210,0cyclictest7199-21kworker/u8:109:55:070
29193992020,0cyclictest0-21swapper/309:05:013
29193992020,0cyclictest0-21swapper/308:47:403
29190992020,0cyclictest0-21swapper/208:47:402
29190992020,0cyclictest0-21swapper/207:52:392
29190992020,0cyclictest0-21swapper/207:15:022
29185992019,0cyclictest4150-21apt-get08:32:391
29185992018,1cyclictest1930-21latency_hist07:20:011
29182992020,0cyclictest0-21swapper/007:42:380
29193991919,0cyclictest0-21swapper/308:57:393
29193991919,0cyclictest0-21swapper/308:52:393
29193991919,0cyclictest0-21swapper/308:32:393
29190991919,0cyclictest9360-21apt-get08:42:392
29185991919,0cyclictest0-21swapper/109:07:401
29185991919,0cyclictest0-21swapper/107:37:381
29185991918,0cyclictest29358-21apt-get08:17:401
29182991919,0cyclictest14150-21apt-get08:52:390
29182991919,0cyclictest0-21swapper/009:07:390
29182991919,0cyclictest0-21swapper/008:47:400
29182991916,2cyclictest28894-21awk08:15:010
29193991818,0cyclictest0-21swapper/309:07:393
29193991818,0cyclictest0-21swapper/308:27:403
29193991818,0cyclictest0-21swapper/308:17:403
29193991818,0cyclictest0-21swapper/307:52:393
29190991818,0cyclictest24505-21apt-get08:07:382
29190991818,0cyclictest0-21swapper/208:17:392
29185991818,0cyclictest0-21swapper/109:02:391
29185991818,0cyclictest0-21swapper/108:27:391
29182991817,1cyclictest0-21swapper/008:07:380
2918299180,17cyclictest0-21swapper/007:35:020
29190991717,0cyclictest6941-21apt-get08:37:392
29190991717,0cyclictest0-21swapper/207:42:382
29190991717,0cyclictest0-21swapper/207:32:382
29190991717,0cyclictest0-21swapper/207:22:382
29185991717,0cyclictest0-21swapper/108:12:391
29185991717,0cyclictest0-21swapper/107:27:361
29185991714,2cyclictest783-21snmpd08:39:101
29182991717,0cyclictest0-21swapper/008:32:390
29182991717,0cyclictest0-21swapper/007:32:380
29182991717,0cyclictest0-21swapper/007:12:380
29182991715,1cyclictest19249-21basename07:55:000
2918299170,16cyclictest0-21swapper/007:57:390
29190991615,1cyclictest21358-21apt-get09:07:392
2919399150,15cyclictest0-21swapper/307:32:153
29190991515,0cyclictest0-21swapper/208:27:392
2918299150,14cyclictest0-21swapper/008:57:290
2918299150,14cyclictest0-21swapper/007:30:010
29193991414,0cyclictest0-21swapper/308:40:183
2919399140,14cyclictest0-21swapper/308:05:073
2919399140,0cyclictest0-21swapper/308:22:353
2919399140,0cyclictest0-21swapper/307:25:553
29190991414,0cyclictest0-21swapper/208:00:032
29190991414,0cyclictest0-21swapper/207:36:192
2919099140,14cyclictest0-21swapper/208:55:342
2919099140,14cyclictest0-21swapper/208:30:392
2919099140,14cyclictest0-21swapper/207:11:292
2918599140,14cyclictest0-21swapper/108:50:051
2918599140,14cyclictest0-21swapper/108:45:091
29182991414,0cyclictest0-21swapper/009:00:180
2918299140,0cyclictest0-21swapper/007:45:070
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional