You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-10 - 19:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot3s.osadl.org (updated Sun May 10, 2026 12:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
99562236164,22sleep20-21swapper/207:05:572
99872229162,54sleep30-21swapper/307:06:223
102442203164,26sleep00-21swapper/007:09:370
101962201164,24sleep10-21swapper/107:09:011
119121660,3sleep01034999cyclictest08:00:130
2552121430,4sleep21035499cyclictest08:55:172
1035499103100,2cyclictest0-21swapper/212:15:502
10354998279,2cyclictest0-21swapper/210:15:292
10354995855,2cyclictest0-21swapper/211:41:192
45482520,4sleep21035499cyclictest11:48:182
233952520,2sleep10-21swapper/108:50:141
10354994037,2cyclictest0-21swapper/209:48:212
1035499391,32cyclictest0-21swapper/207:48:292
1035499391,30cyclictest0-21swapper/207:20:212
1035499391,28cyclictest0-21swapper/208:34:012
10354993621,9cyclictest0-21swapper/208:14:242
1035499361,27cyclictest0-21swapper/207:40:572
1035499341,27cyclictest0-21swapper/211:10:372
1035499341,27cyclictest0-21swapper/211:10:372
1035499341,26cyclictest0-21swapper/208:06:012
1035499341,15cyclictest0-21swapper/210:25:082
1035499331,25cyclictest0-21swapper/209:32:372
1035499331,22cyclictest0-21swapper/211:57:092
1035499331,20cyclictest0-21swapper/209:08:572
1035499331,19cyclictest0-21swapper/209:10:452
1035499331,17cyclictest0-21swapper/212:33:532
1035499331,14cyclictest0-21swapper/211:25:492
1035499330,27cyclictest0-21swapper/207:53:292
1034999334,13cyclictest5677-21basename09:25:010
1035499321,21cyclictest0-21swapper/212:22:092
1035499321,19cyclictest0-21swapper/210:09:122
1034999326,12cyclictest24839-21idleruntime-cro08:55:010
1036399310,22cyclictest0-21swapper/308:40:423
10354993117,8cyclictest0-21swapper/211:06:532
10354993117,7cyclictest0-21swapper/209:57:012
10354993113,9cyclictest0-21swapper/211:51:012
1035499311,21cyclictest0-21swapper/209:01:172
1035499311,14cyclictest0-21swapper/208:03:452
1035499311,13cyclictest0-21swapper/208:22:202
1035499310,13cyclictest0-21swapper/210:48:212
1035499310,13cyclictest0-21swapper/207:12:562
1035499301,16cyclictest0-21swapper/210:52:132
1035499301,15cyclictest0-21swapper/209:19:372
1035499301,13cyclictest0-21swapper/208:47:292
1035499301,12cyclictest0-21swapper/208:44:292
1034999304,13cyclictest9452-21awk08:20:010
1036399292,14cyclictest3420-21df_inode08:05:133
1036399291,13cyclictest27884-21sendmail_mailtr07:45:233
1036399291,11cyclictest0-21swapper/307:56:273
1035499291,22cyclictest0-21swapper/207:16:332
1035499291,18cyclictest0-21swapper/210:31:412
1035499291,12cyclictest0-21swapper/212:02:172
1035499291,12cyclictest0-21swapper/210:23:012
1035499291,12cyclictest0-21swapper/209:26:372
1035499290,20cyclictest0-21swapper/208:53:212
1035499290,12cyclictest0-21swapper/209:20:532
1036399281,10cyclictest0-21swapper/308:46:593
1036399280,12cyclictest0-21swapper/307:43:273
1035499281,26cyclictest0-21swapper/208:28:002
10354992812,3cyclictest21389-21ntp_states12:25:212
10354992812,3cyclictest21389-21ntp_states12:25:212
1035499281,14cyclictest0-21swapper/212:12:122
1035499281,14cyclictest0-21swapper/209:43:372
1035499281,14cyclictest0-21swapper/209:35:532
1035499281,13cyclictest22244-21/usr/sbin/munin07:35:172
1035499281,13cyclictest0-21swapper/210:58:372
1035499281,12cyclictest0-21swapper/211:32:252
1035499281,12cyclictest0-21swapper/210:44:532
1035499280,19cyclictest0-21swapper/211:21:372
1035499280,11cyclictest0-21swapper/211:01:572
76882270,10sleep121-21rcuc/111:55:141
1036399271,17cyclictest0-21swapper/307:25:593
1036399271,15cyclictest5897-21users10:35:273
1036399271,14cyclictest26570-21awk08:55:273
1036399271,12cyclictest31435-21munin-run09:10:013
1036399270,11cyclictest0-21swapper/311:13:073
1036399270,11cyclictest0-21swapper/311:13:063
1036399270,11cyclictest0-21swapper/308:51:273
1036399270,10cyclictest0-21swapper/311:46:033
1036399270,10cyclictest0-21swapper/308:17:273
1036399270,10cyclictest0-21swapper/307:38:593
1035499271,18cyclictest0-21swapper/207:56:132
1035499271,16cyclictest0-21swapper/208:35:052
1035499271,14cyclictest0-21swapper/209:51:212
1035499271,12cyclictest0-21swapper/212:09:052
1035499271,12cyclictest0-21swapper/211:18:532
1035499271,11cyclictest0-21swapper/210:12:042
1035499271,11cyclictest0-21swapper/207:26:492
1035499271,10cyclictest0-21swapper/211:35:452
1035499270,18cyclictest0-21swapper/210:38:252
1035099271,19cyclictest0-21swapper/109:30:251
1036399269,6cyclictest31431-21diskmemload11:44:273
1036399266,3cyclictest0-21swapper/308:35:253
1036399261,13cyclictest15882-21gltestperf11:00:143
1036399261,12cyclictest25318-21rt-features11:20:213
1036399260,12cyclictest0-21swapper/307:52:073
1035499261,11cyclictest0-21swapper/207:33:372
1035499261,10cyclictest0-21swapper/212:36:452
1035499260,19cyclictest0-21swapper/208:16:122
10350992610,4cyclictest16999-21ntp_states12:15:211
1036399251,9cyclictest0-21swapper/311:16:193
1036399251,10cyclictest0-21swapper/307:21:073
1036399250,10cyclictest0-21swapper/308:10:473
1035099251,11cyclictest22758-21sed08:50:011
1035099251,10cyclictest0-21swapper/109:45:061
1034999255,17cyclictest26423-21perf07:45:010
1036399241,8cyclictest0-21swapper/311:55:273
1036399241,8cyclictest0-21swapper/310:00:173
1036399241,20cyclictest31159-21grep11:35:153
1036399241,14cyclictest0-21swapper/309:51:093
1036399241,10cyclictest14327-21gltestperf12:10:133
1036399241,10cyclictest0-21swapper/310:47:073
1036399241,10cyclictest0-21swapper/307:10:113
1036399240,9cyclictest0-21swapper/309:24:193
1036399240,9cyclictest0-21swapper/309:01:593
1036399240,10cyclictest0-21swapper/309:30:113
1035499241,16cyclictest0-21swapper/210:03:452
10350992418,3cyclictest10866-21perl09:35:151
1036399235,3cyclictest0-21swapper/308:04:193
1036399231,12cyclictest9311-21/usr/sbin/munin12:00:223
1036399231,11cyclictest0-21swapper/311:53:013
1036399231,11cyclictest0-21swapper/308:22:493
1036399231,10cyclictest0-21swapper/310:21:113
1036399231,10cyclictest0-21swapper/307:16:173
1036399230,8cyclictest0-21swapper/310:10:393
1036399230,14cyclictest0-21swapper/310:05:193
10350992318,3cyclictest0-21swapper/111:11:171
10350992318,3cyclictest0-21swapper/111:11:171
1035099231,6cyclictest0-21swapper/109:10:111
1035099231,11cyclictest4985-21hddtemp_smartct10:35:171
1035099231,11cyclictest28258-21latency_hist11:30:021
1035099231,11cyclictest0-21swapper/112:24:181
1035099231,11cyclictest0-21swapper/110:18:381
1035099231,10cyclictest0-21swapper/112:37:441
1036399229,3cyclictest0-21swapper/310:50:283
1036399228,2cyclictest0-21swapper/309:35:233
1036399227,9cyclictest0-21swapper/309:45:253
1036399227,3cyclictest13549-21ntp_states09:40:213
1036399227,3cyclictest0-21swapper/312:09:233
1036399226,3cyclictest0-21swapper/308:29:253
1036399225,3cyclictest0-21swapper/307:31:113
1036399225,2cyclictest0-21swapper/310:26:033
1036399223,8cyclictest89250irq/135-enp2s0-08:30:013
1036399221,5cyclictest0-21swapper/309:26:323
1036399221,12cyclictest0-21swapper/311:05:223
1036399220,8cyclictest0-21swapper/310:40:143
1035099227,4cyclictest0-21swapper/109:42:561
1035099222,2cyclictest87550irq/128-enp1s0-10:45:151
1035099222,18cyclictest0-21swapper/107:48:411
1035099221,7cyclictest0-21swapper/110:29:451
1035099221,6cyclictest0-21swapper/110:20:411
1035099221,3cyclictest14067-21df12:10:111
10350992212,2cyclictest0-21swapper/109:26:001
1035099221,18cyclictest31754-21ntp_states11:35:201
1035099221,18cyclictest21394-21ntp_states12:25:221
1035099221,18cyclictest21394-21ntp_states12:25:221
1035099221,15cyclictest0-21swapper/110:00:351
1035099221,11cyclictest0-21swapper/112:31:191
1036399215,3cyclictest0-21swapper/310:57:303
1036399211,9cyclictest30180-21taskset11:31:323
1036399211,3cyclictest28223-21diskstats10:15:133
1036399210,12cyclictest0-21swapper/309:15:153
1035099218,3cyclictest0-21swapper/109:15:311
1035099212,3cyclictest0-21swapper/111:16:221
1035099212,17cyclictest0-21swapper/108:37:571
1035099211,3cyclictest6578-21switchtime08:10:251
1035099211,18cyclictest0-21swapper/108:55:191
1035099211,18cyclictest0-21swapper/108:15:191
1035099211,11cyclictest26413-21awk07:45:011
1035099211,11cyclictest24439-21df_inode11:20:121
10350992110,3cyclictest21400-21sed07:30:241
1035099210,11cyclictest0-21swapper/111:43:441
1034999216,8cyclictest19038-21/usr/sbin/munin12:20:180
1034999215,4cyclictest0-21swapper/011:10:170
1034999215,4cyclictest0-21swapper/011:10:170
1034999214,5cyclictest0-21swapper/012:00:240
1034999214,15cyclictest24508-21perf12:35:010
1034999213,8cyclictest7134-21sendmail_mailtr09:25:230
1034999212,3cyclictest87550irq/128-enp1s0-10:04:300
1034999212,11cyclictest20657-21/usr/sbin/munin08:45:170
1034999211,7cyclictest0-21swapper/010:36:180
1034999211,12cyclictest15648-21/usr/sbin/munin07:20:240
1034999211,10cyclictest11892-21grep10:50:180
1036399206,6cyclictest0-21swapper/312:28:543
1036399206,6cyclictest0-21swapper/312:28:543
1036399204,3cyclictest0-21swapper/312:34:383
1036399204,3cyclictest0-21swapper/312:22:343
1036399200,9cyclictest0-21swapper/310:33:473
1035099209,8cyclictest24170-21kworker/u8:208:01:291
1035099209,3cyclictest18848-21latency_hist09:55:011
1035099208,4cyclictest6598-21runrttasks11:51:221
1035099206,4cyclictest0-21swapper/110:09:031
1035099204,9cyclictest13370-40dnf12:08:311
1035099203,2cyclictest87550irq/128-enp1s0-11:08:241
1035099202,16cyclictest0-21swapper/107:56:301
1035099202,16cyclictest0-21swapper/107:50:091
10350992016,3cyclictest0-21swapper/109:58:211
10350992016,3cyclictest0-21swapper/107:27:241
10350992016,3cyclictest0-21swapper/107:11:161
10350992012,4cyclictest30469-21munin-run11:35:011
1035099201,17cyclictest0-21swapper/111:48:301
1035099201,17cyclictest0-21swapper/108:21:161
1035099201,11cyclictest30520-21ntp_states09:05:221
1035099201,11cyclictest17616-21latency_hist07:25:011
1035099201,11cyclictest13935-21cat08:30:011
1035099201,10cyclictest23619-21timerandwakeup07:35:261
10350992010,2cyclictest8468-21latency_hist10:45:021
1034999205,3cyclictest12050irq/123-ahci[0007:15:020
1034999204,4cyclictest0-21swapper/009:15:490
1034999203,3cyclictest0-21swapper/009:38:400
1034999202,10cyclictest25681-21/usr/sbin/munin10:10:240
1034999201,5cyclictest0-21swapper/012:08:390
10349992011,3cyclictest0-21swapper/010:24:530
1034999201,11cyclictest29457-21/usr/sbin/munin09:05:140
1034999201,11cyclictest21904-21/usr/sbin/munin11:15:240
1034999201,10cyclictest21394-21ntp_states12:25:220
1034999201,10cyclictest21394-21ntp_states12:25:220
1034999201,10cyclictest15299-21/usr/sbin/munin11:00:200
171702191,2sleep317223-21sed12:15:253
1036399194,3cyclictest32718-21ntp_states09:10:193
1036399194,2cyclictest0-21swapper/312:35:103
1036399191,5cyclictest19931-21grep09:55:193
1036399191,2cyclictest0-21swapper/311:25:153
1035099196,6cyclictest0-21swapper/110:13:041
1035099194,6cyclictest0-21swapper/110:50:251
1035099192,3cyclictest13913-21irqstats10:55:201
1035099192,16cyclictest0-21swapper/112:02:511
1035099191,9cyclictest0-21swapper/110:31:301
1035099191,17cyclictest0-21swapper/111:01:391
1035099191,17cyclictest0-21swapper/108:31:541
1035099191,16cyclictest0-21swapper/108:40:531
1035099191,10cyclictest15627-21date07:20:011
1034999194,8cyclictest14628-21unixbench_multi10:55:280
1034999193,9cyclictest0-21swapper/011:45:160
1034999193,7cyclictest10709-21kworker/u8:009:59:400
1034999193,4cyclictest0-21swapper/007:35:260
1034999192,9cyclictest28789-21memory10:15:180
1034999192,9cyclictest19482-21munin-run11:10:010
1034999191,7cyclictest755-21rngd10:45:150
1034999191,11cyclictest25237-21sshd10:07:270
38592181,2sleep00-21swapper/010:32:200
1035099181,9cyclictest28303-21ntpq09:00:211
1035099181,4cyclictest10709-21kworker/u8:009:20:361
1034999184,3cyclictest12050irq/123-ahci[0007:30:000
1034999182,8cyclictest15031-21diskstats09:45:130
1034999182,6cyclictest0-21swapper/011:20:110
1034999181,9cyclictest808-21snmpd12:13:270
1034999181,9cyclictest808-21snmpd08:32:450
1034999181,9cyclictest16783-21latency12:15:180
1034999181,7cyclictest0-21swapper/011:36:330
1034999181,4cyclictest0-21swapper/011:57:030
10349991812,3cyclictest7154-21grep10:40:160
10349991811,4cyclictest10136-21grep08:20:150
286832170,2sleep00-21swapper/007:50:010
1035099171,10cyclictest0-21swapper/108:05:181
1034999174,3cyclictest16870-21tail08:35:170
1034999172,4cyclictest18868-21awk09:55:010
1034999172,4cyclictest0-21swapper/011:40:230
1034999171,9cyclictest87350irq/126-enp1s0-10:29:270
1034999171,7cyclictest29085-21gltestperf11:30:160
1034999171,5cyclictest26303-21users12:35:250
1034999171,5cyclictest0-21swapper/009:34:530
1034999171,2cyclictest0-21swapper/011:25:120
1034999171,2cyclictest0-21swapper/009:40:160
1034999171,2cyclictest0-21swapper/007:20:010
10349991712,3cyclictest6368-21cat11:50:250
10349991712,3cyclictest550-21munin-run08:00:010
1034999171,15cyclictest0-21swapper/008:09:240
1034999171,15cyclictest0-21swapper/007:31:500
10349991711,3cyclictest31656-21/usr/sbin/munin09:10:130
1034999171,13cyclictest25051-21/usr/sbin/munin08:55:170
1034999165,3cyclictest27250-21/usr/sbin/munin09:00:240
1034999161,13cyclictest28836-21/usr/sbin/munin07:50:190
10349991611,3cyclictest19485-21nfs4_client08:40:190
1034999160,7cyclictest0-21swapper/008:29:140
1034999151,3cyclictest87350irq/126-enp1s0-08:10:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional