You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-03 - 14:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot3s.osadl.org (updated Mon Aug 03, 2026 12:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
240032243167,24sleep20-21swapper/207:08:312
221552235166,57sleep10-21swapper/107:05:041
221592223192,21sleep00-21swapper/007:05:080
219622215163,39sleep30-21swapper/307:05:023
2488621840,4sleep32422399cyclictest08:20:233
3071321490,4sleep02420699cyclictest08:35:120
148321450,5sleep12421199cyclictest12:20:251
24216999890,2cyclictest0-21swapper/207:41:242
24216999081,8cyclictest0-21swapper/207:31:202
24216997572,2cyclictest0-21swapper/210:37:142
24216997572,2cyclictest0-21swapper/210:37:142
292842520,1sleep30-21swapper/309:45:143
85342500,4sleep230-21rcuc/207:45:142
2422399391,14cyclictest0-21swapper/312:02:253
2422399391,14cyclictest0-21swapper/311:04:543
24223993515,3cyclictest0-21swapper/308:53:063
2422399351,12cyclictest0-21swapper/309:12:143
2420699358,12cyclictest27120-21perf10:55:010
24223993414,3cyclictest0-21swapper/308:28:453
2422399341,10cyclictest0-21swapper/311:06:343
2421699341,23cyclictest0-21swapper/207:36:172
24223993313,3cyclictest0-21swapper/309:07:543
24223993213,3cyclictest0-21swapper/308:37:173
2422399321,19cyclictest0-21swapper/307:28:583
2421699320,12cyclictest0-21swapper/211:38:552
2420699322,13cyclictest18671-21kworker/0:112:00:260
2422399318,3cyclictest0-21swapper/310:32:053
24223993121,2cyclictest0-21swapper/310:40:173
2422399311,5cyclictest3348-21kworker/u8:211:25:013
2421699311,13cyclictest909-21sssd_nss11:25:152
2420699316,12cyclictest7961-21munin-run07:45:020
2420699312,11cyclictest7094-21kworker/0:210:30:010
2420699311,10cyclictest7094-21kworker/0:211:10:130
24223993014,6cyclictest0-21swapper/307:40:183
2422399301,13cyclictest0-21swapper/309:35:013
2422399301,12cyclictest0-21swapper/310:59:583
2421699301,7cyclictest30586-21open_files07:20:232
2421699301,13cyclictest0-21swapper/208:26:262
2421699301,11cyclictest19952-21acpi09:25:112
2421699301,11cyclictest19952-21acpi09:25:112
2421699301,11cyclictest0-21swapper/208:51:202
2420699307,11cyclictest23470-21basename08:20:020
2420699306,12cyclictest2098-21awk08:45:010
2420699305,3cyclictest31338-21kworker/0:112:31:370
2420699302,20cyclictest19424-21kworker/0:207:11:180
2420699301,11cyclictest27818-21kworker/0:212:15:170
2422399291,12cyclictest0-21swapper/311:38:173
2422399290,4cyclictest0-21swapper/309:55:523
2421699290,27cyclictest0-21swapper/209:21:032
2420699291,12cyclictest14574-21kworker/0:311:43:220
2422399289,3cyclictest8148-21timerwakeupswit08:55:263
2422399281,13cyclictest0-21swapper/311:28:383
2422399281,11cyclictest0-21swapper/310:38:013
2422399281,11cyclictest0-21swapper/310:38:013
24223992810,6cyclictest0-21swapper/311:40:453
24223992810,3cyclictest0-21swapper/307:21:303
2421699280,9cyclictest0-21swapper/209:00:202
2421699280,26cyclictest0-21swapper/210:50:362
2421699280,12cyclictest0-21swapper/207:54:192
2420699282,11cyclictest27749-21kworker/0:008:30:130
2420699282,11cyclictest12169-21kworker/0:011:35:020
2420699282,10cyclictest16684-21kworker/0:108:10:260
2422399272,2cyclictest0-21swapper/309:40:593
24223992715,3cyclictest0-21swapper/308:33:573
24223992710,2cyclictest0-21swapper/309:15:263
2421699278,9cyclictest0-21swapper/207:11:292
2421699271,12cyclictest0-21swapper/211:07:512
2421699271,11cyclictest0-21swapper/209:49:432
2421699270,12cyclictest0-21swapper/208:32:122
2421699270,11cyclictest0-21swapper/207:19:042
2420699279,3cyclictest7094-21kworker/0:211:04:290
2420699273,2cyclictest87550irq/128-enp1s0-09:18:050
2420699272,17cyclictest4163-21kworker/0:012:30:010
2420699272,10cyclictest4839-21kworker/0:010:03:220
2420699270,12cyclictest29279-21awk07:20:010
2422399261,4cyclictest0-21swapper/310:50:183
24223992612,2cyclictest0-21swapper/311:55:253
2422399261,16cyclictest19501-21kworker/u8:009:23:503
2421699265,2cyclictest0-21swapper/209:58:192
2421699261,11cyclictest0-21swapper/209:08:232
2421699260,11cyclictest0-21swapper/210:19:232
2421699260,11cyclictest0-21swapper/209:53:272
2420699268,3cyclictest23937-21kworker/0:009:37:180
2420699267,3cyclictest26279-21kworker/0:109:46:380
24206992611,3cyclictest3942-21kworker/0:109:30:140
305252251,20sleep130559-21ntp_states07:20:221
2422399258,3cyclictest0-21swapper/312:14:293
2422399257,3cyclictest0-21swapper/308:45:453
2422399251,21cyclictest24369-21/usr/sbin/munin09:35:163
2422399251,21cyclictest19287-21/usr/sbin/munin08:10:253
24223992511,3cyclictest0-21swapper/310:00:173
2422399251,12cyclictest0-21swapper/312:16:573
24223992510,3cyclictest0-21swapper/312:29:213
24223992510,2cyclictest0-21swapper/310:12:333
2422399250,14cyclictest0-21swapper/309:27:543
2422399250,14cyclictest0-21swapper/309:27:543
2421699251,9cyclictest14058-21latency_hist10:25:012
2421699251,9cyclictest0-21swapper/210:10:112
2421699251,9cyclictest0-21swapper/208:48:082
2421699251,13cyclictest0-21swapper/210:43:122
2421699250,9cyclictest0-21swapper/211:22:152
2420699258,3cyclictest2540-21kworker/0:110:11:180
2420699256,12cyclictest27760-21grep09:40:240
2420699253,2cyclictest7094-21kworker/0:211:09:090
2420699252,10cyclictest2540-21kworker/0:110:07:180
2420699252,10cyclictest20058-21kworker/0:110:40:090
24206992511,3cyclictest31097-21kworker/0:207:20:290
24206992510,3cyclictest7094-21kworker/0:210:31:490
24206992510,2cyclictest31111-21kworker/0:307:25:500
2422399247,3cyclictest0-21swapper/310:21:493
2422399247,3cyclictest0-21swapper/310:18:493
2422399246,3cyclictest0-21swapper/307:19:453
24223992419,3cyclictest0-21swapper/310:06:053
2422399241,21cyclictest0-21swapper/311:19:073
2422399241,20cyclictest32472-21/usr/sbin/munin12:20:163
24223992411,3cyclictest20846-21seq11:50:333
2422399240,16cyclictest0-21swapper/308:02:173
2422399240,14cyclictest0-21swapper/309:00:463
2421699249,10cyclictest15991-21proc_pri11:40:232
2421699247,3cyclictest0-21swapper/208:22:232
2421699241,10cyclictest0-21swapper/210:34:522
2421699241,10cyclictest0-21swapper/208:35:062
2421699240,10cyclictest0-21swapper/212:01:272
2421699240,10cyclictest0-21swapper/210:25:402
2421199248,4cyclictest30624-21diskstats12:15:161
2420699249,3cyclictest87550irq/128-enp1s0-07:33:260
2420699249,2cyclictest19417-21kworker/0:009:25:260
2420699249,2cyclictest19417-21kworker/0:009:25:260
2420699248,3cyclictest20059-21kernelversion11:50:180
2420699242,8cyclictest18671-21kworker/0:111:56:020
2420699242,4cyclictest16684-21kworker/0:108:09:460
2420699242,2cyclictest87550irq/128-enp1s0-10:56:570
2420699242,11cyclictest7094-21kworker/0:210:37:490
2420699242,11cyclictest7094-21kworker/0:210:37:490
24206992416,5cyclictest343-21df_inode12:20:130
2422399233,15cyclictest87650irq/129-enp1s0-08:15:253
2422399232,10cyclictest8184-21/usr/sbin/munin07:45:263
2422399231,2cyclictest0-21swapper/309:50:153
2422399231,11cyclictest17033-21/usr/sbin/munin11:45:263
2422399231,11cyclictest17033-21/usr/sbin/munin11:45:263
2422399231,10cyclictest0-21swapper/310:28:503
2422399230,14cyclictest0-21swapper/311:34:033
2421699238,3cyclictest0-21swapper/212:29:362
2421699238,2cyclictest0-21swapper/208:10:152
2421699237,7cyclictest17628-21cut09:20:012
2421699236,10cyclictest0-21swapper/208:04:392
2421699231,9cyclictest0-21swapper/211:16:372
2421699231,9cyclictest0-21swapper/209:41:212
2421699231,14cyclictest0-21swapper/209:35:152
2421699231,11cyclictest4844-21df12:30:142
2421699231,11cyclictest0-21swapper/207:56:012
2421699231,10cyclictest0-21swapper/212:09:132
2421699230,9cyclictest0-21swapper/212:20:082
2421199232,16cyclictest0-21swapper/110:47:431
24211992318,4cyclictest0-21swapper/109:24:571
2421199231,5cyclictest20873-21wc09:25:191
2421199231,5cyclictest20873-21wc09:25:191
2421199231,20cyclictest0-21swapper/110:50:571
2421199231,19cyclictest22958-21irqstats09:30:181
2421199231,16cyclictest0-21swapper/111:08:451
2421199230,17cyclictest0-21swapper/110:56:391
2421199230,15cyclictest18297-21smartctl11:45:261
2421199230,15cyclictest18297-21smartctl11:45:251
2420699237,2cyclictest32516-21kworker/0:209:55:260
2420699231,6cyclictest0-21swapper/009:52:480
2420699231,6cyclictest0-21swapper/009:12:410
2420699231,3cyclictest31111-21kworker/0:307:46:340
24206992311,2cyclictest19417-21kworker/0:009:21:540
2420699231,10cyclictest3942-21kworker/0:109:03:410
28802220,5sleep12421199cyclictest11:10:251
247632220,4sleep1221ktimersoftd/107:10:151
2422399229,4cyclictest0-21swapper/312:05:253
2422399228,3cyclictest17070-21/usr/sbin/munin08:05:143
2422399224,2cyclictest0-21swapper/307:35:223
2422399223,5cyclictest0-21swapper/307:53:253
2422399221,12cyclictest0-21swapper/307:10:573
2422399221,11cyclictest0-21swapper/312:37:173
2422399221,10cyclictest13086-21diskmemload12:31:503
2422399221,10cyclictest13086-21diskmemload10:45:493
2422399220,5cyclictest0-21swapper/311:10:413
2421699228,3cyclictest7129-21grep08:55:162
2421699228,3cyclictest0-21swapper/211:59:252
2421699222,3cyclictest87550irq/128-enp1s0-09:31:252
2421699221,9cyclictest946-21runrttasks07:25:552
2421699221,11cyclictest0-21swapper/211:10:512
2421699221,10cyclictest0-21swapper/210:58:522
2421699221,10cyclictest0-21swapper/210:09:032
2421699221,10cyclictest0-21swapper/208:15:332
2421699221,10cyclictest0-21swapper/208:09:572
2421699220,9cyclictest0-21swapper/211:03:592
2421699220,11cyclictest0-21swapper/210:04:272
2421199222,15cyclictest0-21swapper/108:32:141
2421199222,11cyclictest4871-21ntp_states11:15:211
2421199221,4cyclictest0-21swapper/109:45:491
24211992214,3cyclictest0-21swapper/111:20:501
24211992212,3cyclictest9975-21cstates10:15:141
2421199221,19cyclictest1626-21irqstats09:55:201
2421199221,19cyclictest0-21swapper/108:15:241
2421199221,18cyclictest17634-21fschecks_time08:05:161
2421199221,15cyclictest0-21swapper/109:42:221
2421199220,16cyclictest0-21swapper/110:00:191
2420699229,4cyclictest7094-21kworker/0:210:19:090
2420699229,3cyclictest7643-21kworker/0:011:23:020
2420699224,4cyclictest3547-21kworker/0:111:28:380
2420699221,2cyclictest87650irq/129-enp1s0-10:24:090
2422399217,3cyclictest0-21swapper/308:41:013
2421699218,2cyclictest1320-21gunzip08:40:242
2421699211,9cyclictest0-21swapper/211:30:212
2421699211,11cyclictest0-21swapper/212:18:222
2421699211,10cyclictest0-21swapper/211:50:412
2421699210,9cyclictest0-21swapper/209:10:532
2421199212,15cyclictest0-21swapper/110:06:471
24211992117,3cyclictest0-21swapper/108:39:401
2421199211,16cyclictest0-21swapper/110:21:051
2421199211,12cyclictest0-21swapper/109:53:381
2421199211,11cyclictest30056-21/usr/sbin/munin12:15:021
2421199211,10cyclictest0-21swapper/112:05:031
2420699215,2cyclictest87550irq/128-enp1s0-07:59:100
2420699214,2cyclictest25496-21kworker/0:108:26:410
2420699213,15cyclictest19025-21perf11:50:020
2420699213,15cyclictest19025-21perf11:50:020
2420699211,3cyclictest23213-21kworker/0:208:23:370
2420699211,2cyclictest87650irq/129-enp1s0-09:05:570
2420699211,12cyclictest14415-21kworker/0:111:38:420
24206992110,2cyclictest3942-21kworker/0:108:51:170
2421699201,8cyclictest0-21swapper/211:49:352
2421699201,8cyclictest0-21swapper/211:49:352
2421699200,9cyclictest0-21swapper/212:11:452
2421699200,11cyclictest0-21swapper/212:37:302
2421199209,3cyclictest14214-21users07:55:291
2421199208,3cyclictest32041-21diskstats07:25:151
2421199208,3cyclictest0-21swapper/110:37:061
2421199208,3cyclictest0-21swapper/110:37:051
2421199205,3cyclictest87550irq/128-enp1s0-09:15:111
2421199202,17cyclictest0-21swapper/111:01:441
2421199202,16cyclictest0-21swapper/108:51:481
2421199201,9cyclictest0-21swapper/112:02:081
24211992016,3cyclictest0-21swapper/109:04:581
24211992016,3cyclictest0-21swapper/107:31:491
2421199201,3cyclictest808-21snmpd12:39:411
2421199201,3cyclictest0-21swapper/111:50:261
24211992013,2cyclictest0-21swapper/110:10:421
24211992013,2cyclictest0-21swapper/108:21:121
2421199201,2cyclictest6710-21if_enp2s007:40:141
2421199201,17cyclictest13086-21diskmemload11:34:571
2421199201,14cyclictest0-21swapper/110:44:511
2421199201,14cyclictest0-21swapper/108:41:201
2421199201,12cyclictest0-21swapper/111:55:321
2421199201,11cyclictest5739-21munin-run07:40:011
2421199201,11cyclictest3542-21sendmail_mailqu12:25:241
2421199201,10cyclictest0-21swapper/112:30:581
2421199200,5cyclictest0-21swapper/109:38:211
2421199200,15cyclictest0-21swapper/111:25:261
2420699209,3cyclictest31111-21kworker/0:308:03:180
2420699209,2cyclictest31338-21kworker/0:112:35:130
2420699202,4cyclictest6174-21kworker/0:208:55:370
2420699201,8cyclictest31111-21kworker/0:307:53:020
2420699201,8cyclictest31111-21kworker/0:307:36:260
2420699201,3cyclictest569-21kworker/0:208:45:050
2420699201,12cyclictest0-21swapper/012:11:180
144372201,2sleep30-21swapper/307:58:123
2422399191,5cyclictest1534-21/usr/sbin/munin07:30:253
2421199199,2cyclictest26875-21strings08:25:201
2421199192,16cyclictest0-21swapper/108:13:261
2421199191,17cyclictest0-21swapper/109:13:081
2421199191,14cyclictest0-21swapper/110:30:421
2421199191,10cyclictest8519-21taskset07:45:131
2421199191,10cyclictest16824-21cat08:04:551
2421199191,10cyclictest11214-21awk07:50:181
2421199190,6cyclictest0-21swapper/111:35:081
2421199190,17cyclictest0-21swapper/107:15:161
2420699191,2cyclictest87350irq/126-enp1s0-10:48:120
2420699191,10cyclictest5069-21smart_sda11:15:250
2420699191,10cyclictest25842-21/usr/sbin/munin12:05:190
2421699188,3cyclictest87550irq/128-enp1s0-10:46:212
2421199188,3cyclictest7464-21if_enp2s008:55:171
2421199186,3cyclictest3159-21kernelversion08:45:201
2421199181,9cyclictest0-21swapper/110:29:391
24211991815,2cyclictest0-21swapper/109:07:401
2421199181,16cyclictest0-21swapper/111:40:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional