You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-12 - 00:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sat Apr 11, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
60045521900,2sleep3471rcuc/308:31:243
7832072920,5chrt0-21swapper/111:36:261
8081342830,4sleep30-21swapper/312:01:253
7314422700,3chrt75-21kworker/3:1-events10:45:003
515845995751,4cyclictest781149-21kworker/u8:0+flush-8:011:51:350
515851995536,17cyclictest631689-21apt-get09:05:012
515845995449,3cyclictest571755-21kworker/u8:1+flush-8:008:31:330
515845995347,4cyclictest642308-21kworker/u8:2+flush-8:010:21:350
515847995043,5cyclictest601823-21kworker/u8:0+flush-8:008:41:221
515847995043,5cyclictest463959-21kworker/u8:2+flush-8:008:16:341
515845995037,8cyclictest676760-21latency_hist09:50:010
515847994939,7cyclictest800937-21latency_hist11:55:011
515847994841,4cyclictest642308-21kworker/u8:2+events_unbound11:26:231
7768762470,1sleep0776879-21grep11:31:200
515847994737,7cyclictest771287-21latency_hist11:25:011
515847994737,7cyclictest587454-21/usr/sbin/munin08:21:281
515847994737,7cyclictest280-21systemd-journal11:15:011
515845994739,7cyclictest642308-21kworker/u8:2+flush-8:009:31:300
515845994737,4cyclictest601823-21kworker/u8:0+events_unbound08:41:350
515851994637,7cyclictest280-21systemd-journal10:40:002
515847994639,5cyclictest542102-21kworker/u8:3+flush-8:007:56:341
515845994641,3cyclictest577009-21latency_hist08:10:010
515845994638,6cyclictest656106-21ntpq09:26:290
515845994540,3cyclictest642308-21kworker/u8:2+events_unbound09:21:230
515845994539,4cyclictest587382-21kworker/u8:4+flush-8:010:06:200
515845994536,6cyclictest520709-21latency_hist07:15:010
515847994439,4cyclictest571755-21kworker/u8:1+flush-8:008:06:221
515847994437,5cyclictest652223-21kworker/u8:1+flush-8:010:11:331
515845994439,4cyclictest642308-21kworker/u8:2+flush-8:010:36:200
515845994438,4cyclictest509998-21kworker/u8:0+events_unbound07:16:230
515847994333,8cyclictest280-21systemd-journal10:46:321
515845994333,7cyclictest717156-21diskstats10:31:210
515847994238,3cyclictest509998-21kworker/u8:0+flush-8:007:36:251
515847994236,4cyclictest687252-21apt-get10:01:161
515847994232,7cyclictest840750-21/usr/sbin/munin12:36:251
515845994236,4cyclictest642308-21kworker/u8:2+flush-8:011:16:190
515845994236,4cyclictest642308-21kworker/u8:2+events_unbound11:36:340
515845994135,4cyclictest805588-21kworker/u8:1+events_unbound12:31:220
515845994135,4cyclictest751196-21kworker/u8:1+events_unbound11:06:280
515845994135,4cyclictest587382-21kworker/u8:4+flush-8:008:21:260
515845994135,4cyclictest587382-21kworker/u8:4+events_unbound09:41:340
515845994135,4cyclictest509998-21kworker/u8:0+flush-8:007:41:240
515845994133,6cyclictest681082-21ntpq09:51:280
515851994025,13cyclictest532932-21aten2_r5power_p07:26:182
515847994034,5cyclictest587382-21kworker/u8:4+flush-8:010:51:241
515847994034,4cyclictest587382-21kworker/u8:4+flush-8:010:41:351
515847994032,5cyclictest587382-21kworker/u8:4+flush-8:009:01:201
515845993929,7cyclictest815730-21latency_hist12:10:010
515851993820,15cyclictest601956-21cron08:35:002
515847993830,6cyclictest280-21systemd-journal12:01:531
515845993833,4cyclictest463959-21kworker/u8:2+events_unbound08:16:230
515845993829,7cyclictest746455-21latency_hist11:00:000
515845993829,7cyclictest746455-21latency_hist11:00:000
515845993732,3cyclictest587382-21kworker/u8:4+flush-8:011:01:230
515845993731,4cyclictest652223-21kworker/u8:1+flush-8:010:01:210
6586852360,2sleep3471rcuc/309:31:243
515847993631,4cyclictest542102-21kworker/u8:3+flush-8:007:51:331
515845993632,3cyclictest587382-21kworker/u8:4+flush-8:009:01:350
515845993630,4cyclictest463959-21kworker/u8:2+flush-8:007:21:210
515845993629,5cyclictest706847-21kworker/u8:0+flush-8:010:51:310
515845993628,6cyclictest732025-21diskstats10:46:190
515847993530,3cyclictest662977-21irqrtprio09:36:221
515847993529,4cyclictest751196-21kworker/u8:1+events_unbound11:31:371
515847993529,4cyclictest642308-21kworker/u8:2+flush-8:010:21:331
515847993529,4cyclictest587382-21kworker/u8:4+flush-8:008:46:201
515845993530,4cyclictest642308-21kworker/u8:2+flush-8:011:56:410
515845993528,5cyclictest571755-21kworker/u8:1+flush-8:008:26:320
51584599350,32cyclictest835543-21munin-run12:30:000
5148992353,8sleep20-21swapper/207:06:332
51585199348,9cyclictest607290-21apt-get08:41:172
515851993421,11cyclictest562860-21fschecks_time07:56:222
515847993429,3cyclictest667237-21apt-get09:41:151
515847993426,6cyclictest625895-21ntpq08:56:291
515847993425,7cyclictest577352-21apt-get08:11:161
515845993428,4cyclictest509998-21kworker/u8:0+flush-8:008:01:190
515845993427,5cyclictest621811-21cron08:55:000
515845993427,5cyclictest621811-21cron08:55:000
515851993318,2cyclictest652655-21fschecks_time09:26:212
515851993316,15cyclictest657555-21cpuspeed_turbos09:31:182
515847993328,3cyclictest652223-21kworker/u8:1+flush-8:009:56:231
515847993325,6cyclictest790718-21grep11:41:341
515845993327,4cyclictest542102-21kworker/u8:3+events_unbound07:51:340
515845993324,7cyclictest845393-21latency_hist12:40:010
515851993211,6cyclictest676757-21sh09:50:002
515847993226,4cyclictest601823-21kworker/u8:0+flush-8:008:36:211
515847993225,6cyclictest642308-21kworker/u8:2+flush-8:012:06:331
515845993227,3cyclictest771305-21systemd-run11:25:010
515845993227,3cyclictest642308-21kworker/u8:2+events_unbound10:16:350
515845993226,4cyclictest587382-21kworker/u8:4+events_unbound10:15:000
515845993225,5cyclictest788986-21kworker/u8:3+events_unbound12:11:320
515845993225,5cyclictest642308-21kworker/u8:2+events_unbound11:41:290
515851993118,2cyclictest806562-21fschecks_time12:01:202
515851993116,2cyclictest711975-21aten2_r5power_c10:26:172
515845993127,3cyclictest542102-21kworker/u8:3+events_unbound07:46:350
5115082313,22sleep0511598-21/usr/sbin/munin07:06:230
6146582300,2sleep3451irq_work/308:46:253
515847993026,3cyclictest542102-21kworker/u8:3+flush-8:007:46:211
515847993022,6cyclictest280-21systemd-journal09:17:011
515845993026,3cyclictest642308-21kworker/u8:2+flush-8:011:11:350
515845993026,3cyclictest587382-21kworker/u8:4+flush-8:008:46:350
515845993024,4cyclictest652223-21kworker/u8:1+events_unbound09:56:340
515845993021,6cyclictest581545-21grep08:11:360
51585199292,9cyclictest829753-21ntpq12:21:292
515851992912,6cyclictest280-21systemd-journal11:25:002
515847992921,6cyclictest801278-21apt-get11:56:161
515847992921,6cyclictest463959-21kworker/u8:2+flush-8:007:26:341
515845992925,3cyclictest805588-21kworker/u8:1+flush-8:012:01:250
515845992925,3cyclictest587382-21kworker/u8:4+flush-8:008:56:260
515845992923,4cyclictest788986-21kworker/u8:3+flush-8:012:16:300
515845992923,4cyclictest611929-21kworker/u8:1+events_unbound09:06:240
515847992825,2cyclictest880-21mta-sts-daemon09:11:351
515847992825,2cyclictest516286-21cpuspeed_turbos07:11:171
515847992824,2cyclictest752500-21irqrtprio11:06:261
515845992824,3cyclictest509998-21kworker/u8:0+events_unbound07:36:170
515845992820,6cyclictest463959-21kworker/u8:2+events_unbound07:26:300
515851992723,2cyclictest760956-21unixbench_multi11:11:362
515851992723,2cyclictest666550-21unixbench_singl09:36:352
515847992723,3cyclictest549864-21kthreadcore07:41:251
515847992719,6cyclictest280-21systemd-journal10:58:541
515847992719,6cyclictest280-21systemd-journal10:58:541
515845992723,3cyclictest706847-21kworker/u8:0+events_unbound10:26:300
515845992722,3cyclictest567119-21sendmail08:00:000
515845992721,5cyclictest587382-21kworker/u8:4+flush-8:009:36:280
515845992719,6cyclictest642308-21kworker/u8:2+flush-8:010:41:290
515851992622,2cyclictest691463-21unixbench_multi10:01:362
515851992617,7cyclictest280-21systemd-journal12:35:542
515847992622,3cyclictest838009-21kthreadcore12:31:241
515847992622,2cyclictest501002-21kworker/u8:1+events_unbound07:16:341
515847992622,2cyclictest0-21swapper/108:05:001
515845992622,3cyclictest781149-21kworker/u8:0+events_unbound11:46:320
515845992622,3cyclictest601823-21kworker/u8:0+events_unbound08:36:210
515845992622,2cyclictest885-21mta-sts-daemon11:30:010
515845992620,4cyclictest541988-21unixbench_multi07:31:360
515851992522,2cyclictest791471-21aten2_r5power_p11:46:162
515851992521,2cyclictest702084-21aten2_r5power_e10:16:162
515851992520,3cyclictest0-21swapper/212:35:002
515847992521,2cyclictest828139-21kthreadcore12:21:251
515847992520,3cyclictest716549-21cron10:30:001
515847992520,3cyclictest0-21swapper/108:31:191
515847992519,4cyclictest280-21systemd-journal09:20:531
515847992419,4cyclictest652223-21kworker/u8:1+flush-8:009:51:211
515847992419,4cyclictest642308-21kworker/u8:2+flush-8:012:10:241
515847992418,5cyclictest587382-21kworker/u8:4+events_unbound11:01:321
515845992420,2cyclictest0-21swapper/012:21:160
515845992419,2cyclictest0-21swapper/009:15:010
515851992319,3cyclictest581560-21unixbench_multi08:11:362
515851992319,2cyclictest776911-21fschecks_time11:31:202
515847992316,5cyclictest766311-21latency_hist11:20:011
515847992315,3cyclictest0-21swapper/109:06:241
515847992313,8cyclictest834648-21ntpq12:26:291
515845992317,3cyclictest643141-21irqrtprio09:16:220
515851992218,3cyclictest0-21swapper/208:40:002
515851992215,5cyclictest596032-21journal-offline08:26:282
515847992219,2cyclictest593157-21irqrtprio08:26:241
515847992218,2cyclictest821739-21irqrtprio12:16:231
515847992218,2cyclictest722583-21irqrtprio10:36:231
515847992216,5cyclictest795658-21unixbench_multi11:46:331
515851992118,2cyclictest641527-21unixbench_singl09:11:362
515851992118,2cyclictest582554-21fschecks_count08:16:202
515851992117,3cyclictest0-21swapper/210:35:002
515851992117,2cyclictest761695-21aten2_r5power_c11:16:162
515851992117,2cyclictest0-21swapper/207:46:272
515851992116,3cyclictest781703-21tr11:36:202
515851992115,4cyclictest620914-21needreboot08:51:272
515851992115,4cyclictest620914-21needreboot08:51:272
515851992112,7cyclictest280-21systemd-journal11:00:002
515851992112,7cyclictest280-21systemd-journal11:00:002
515847992117,2cyclictest0-21swapper/110:31:191
515847992117,2cyclictest0-21swapper/110:20:001
515847992117,2cyclictest0-21swapper/109:46:351
515847992116,3cyclictest0-21swapper/109:26:251
515847992115,4cyclictest0-21swapper/110:06:191
515847992115,4cyclictest0-21swapper/108:51:181
515847992115,4cyclictest0-21swapper/108:51:181
515847992113,6cyclictest657321-21apt-get09:31:151
5153902214,11sleep10-21swapper/107:06:481
51585199202,13cyclictest811163-21apt-get12:06:152
515851992016,3cyclictest0-21swapper/209:10:012
515851992010,8cyclictest818067-21tr12:11:252
51584799206,5cyclictest0-21swapper/107:34:131
515847992016,2cyclictest0-21swapper/107:21:271
5155112205,8sleep30-21swapper/307:08:223
515851991916,2cyclictest737147-21cpuspeed_turbos10:51:192
515851991915,2cyclictest532128-21unixbench_multi07:21:362
515851991915,2cyclictest0-21swapper/210:06:362
515851991914,3cyclictest0-21swapper/207:16:332
515851991910,7cyclictest800937-21sh11:55:002
6042332180,1sleep30-21swapper/308:36:263
515851991815,2cyclictest726906-21aten2_r5power_p10:41:182
515851991814,3cyclictest647052-21cron09:20:012
515851991814,2cyclictest0-21swapper/212:16:242
515851991814,2cyclictest0-21swapper/209:25:012
515851991814,2cyclictest0-21swapper/208:21:192
515851991814,2cyclictest0-21swapper/207:41:342
515851991813,3cyclictest0-21swapper/210:21:252
515851991810,6cyclictest543698-21tr07:36:252
51585199179,6cyclictest803878-21tr11:56:272
51585199176,8cyclictest624988-21tr08:56:262
515851991714,2cyclictest516413-21fschecks_time07:11:192
515851991713,2cyclictest612518-21fschecks_count08:46:202
515851991713,2cyclictest0-21swapper/212:26:282
515851991713,2cyclictest0-21swapper/211:41:162
515851991713,2cyclictest0-21swapper/210:46:222
515851991713,2cyclictest0-21swapper/209:41:272
515851991713,2cyclictest0-21swapper/208:01:362
515851991711,5cyclictest679178-21kthreadcore09:51:252
51585199171,11cyclictest686033-21ntpq09:56:292
51585199162,13cyclictest0-21swapper/207:30:282
515851991613,2cyclictest0-21swapper/211:00:172
515851991611,3cyclictest0-21swapper/211:06:272
51585199161,11cyclictest557548-21acpi07:51:152
8160512152,8sleep30-21swapper/312:11:173
6172062152,8sleep30-21swapper/308:51:163
6172062152,8sleep30-21swapper/308:51:163
51585199158,5cyclictest771964-21tune2fs11:26:212
51585199152,12cyclictest0-21swapper/208:06:032
51585199151,10cyclictest697091-21apt-get10:11:162
8296462132,7sleep30-21swapper/312:21:283
7901392132,7sleep30-21swapper/311:41:273
7713072132,6sleep30-21swapper/311:25:023
6561642132,7sleep30-21swapper/309:26:313
6369342132,6sleep30-21swapper/309:10:023
5872012132,6sleep30-21swapper/308:20:023
5198292132,7sleep30-21swapper/307:11:273
8428752120,2sleep3471rcuc/312:36:243
8367482123,6sleep30-21swapper/312:31:233
8351792122,6sleep30-21swapper/312:26:383
8214352122,6sleep30-21swapper/312:16:223
8041052123,6sleep30-21swapper/311:56:283
8002682122,6sleep30-21swapper/311:51:343
7913902122,6sleep30-21swapper/311:46:173
7858472122,6sleep30-21swapper/311:37:063
7768052121,7sleep30-21swapper/311:31:203
7659192122,6sleep30-21swapper/311:16:353
7520982122,6sleep30-21swapper/311:06:243
7464132122,6sleep30-21swapper/310:59:463
7464132122,6sleep30-21swapper/310:59:463
7218072122,6sleep30-21swapper/310:35:543
7209312122,6sleep30-21swapper/310:31:363
6970362122,6sleep30-21swapper/310:10:543
6963222122,6sleep30-21swapper/310:06:363
6778402122,6sleep30-21swapper/309:51:233
6725552122,6sleep30-21swapper/309:46:223
6714642122,6sleep30-21swapper/309:41:363
6511392122,6sleep30-21swapper/309:21:303
6337892123,5sleep30-21swapper/309:06:253
5675572123,6sleep30-21swapper/308:01:203
5621862122,6sleep30-21swapper/307:55:023
5525182122,5sleep30-21swapper/307:45:023
5515552122,6sleep30-21swapper/307:41:333
5467322122,6sleep30-21swapper/307:36:363
5374272122,5sleep30-21swapper/307:30:013
5276792122,6sleep30-21swapper/307:20:023
8114122112,5sleep30-21swapper/312:06:193
7665742112,6sleep30-21swapper/311:20:243
7609792112,5sleep30-21swapper/311:11:373
7467742112,6sleep30-21swapper/311:01:063
7369392112,5sleep30-21swapper/310:51:193
7317792112,5sleep30-21swapper/310:46:173
7119162112,5sleep30-21swapper/310:26:153
7072732112,5sleep30-21swapper/310:21:213
7019992112,5sleep30-21swapper/310:16:153
6871302112,5sleep30-21swapper/310:00:013
6825522112,5sleep30-21swapper/309:56:213
6620062112,5sleep30-21swapper/309:35:023
6423142113,5sleep30-21swapper/309:15:123
6270942112,5sleep30-21swapper/309:01:153
6224782112,5sleep30-21swapper/308:56:223
6071692112,5sleep30-21swapper/308:40:043
5924442112,5sleep30-21swapper/308:26:203
5772302112,5sleep30-21swapper/308:10:023
5726152112,6sleep30-21swapper/308:06:213
5614082112,5sleep30-21swapper/307:51:323
5327252112,5sleep30-21swapper/307:25:043
5233302112,5sleep30-21swapper/307:16:213
5821462102,5sleep30-21swapper/308:15:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional