You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-28 - 00:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Thu Aug 27, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4131622992112,206cyclictest0-21swapper/212:37:422
413161299152134,16cyclictest265444-21kthreadcore12:37:420
448302660,5sleep20-21swapper/208:57:382
413161299600,57cyclictest222143-21true11:55:000
4131617995950,7cyclictest18618-21apt-get08:28:271
4131617995948,8cyclictest275-21systemd-journal08:50:001
2451352590,5sleep20-21swapper/212:17:392
4131612995650,4cyclictest4110975-21kworker/u8:2+flush-8:007:20:000
4131617995445,6cyclictest132853-21latency_hist10:25:011
4131617995444,7cyclictest275-21systemd-journal09:05:011
1142702520,2sleep3575-21kworker/3:2-mm_percpu_wq10:07:383
4131617995144,5cyclictest58590-21cp09:10:011
1348812490,2sleep3481ktimers/310:27:413
4131612994632,12cyclictest4168645-21journal-offline07:47:320
4131612994629,15cyclictest4147538-21needreboot07:22:430
4131612994624,19cyclictest177399-21latency_hist11:10:010
4131612994535,8cyclictest275-21systemd-journal09:20:010
4131617994430,11cyclictest275-21systemd-journal07:38:281
4131612994428,14cyclictest182328-21systemd-run11:15:010
4131612994332,8cyclictest275-21systemd-journal08:30:010
4131612994315,19cyclictest0-21swapper/008:00:000
413161299422,24cyclictest0-21swapper/012:05:120
413161299421,29cyclictest573-21runrttasks09:04:580
413161299420,30cyclictest573-21runrttasks11:22:220
4131617994137,3cyclictest242341-21kworker/u8:2+events_unbound12:18:281
4131617994135,4cyclictest3676-21kworker/u8:1+events_unbound08:20:381
4131617994133,5cyclictest187501-21latency_hist11:20:011
4131612994127,12cyclictest0-21swapper/010:10:000
4131612994121,18cyclictest851-21mta-sts-daemon09:32:490
413161299411,29cyclictest573-21runrttasks09:29:580
413161299411,28cyclictest573-21runrttasks09:48:240
413161299410,39cyclictest1-21systemd08:57:270
413161299410,30cyclictest573-21runrttasks11:16:040
4131622994033,5cyclictest275-21systemd-journal08:32:442
4131617994033,5cyclictest275-21systemd-journal10:59:281
4131612994027,11cyclictest275-21systemd-journal09:43:010
413161299402,25cyclictest0-21swapper/010:38:560
4131622993928,9cyclictest252028-21awk12:25:002
4131617993931,6cyclictest162533-21latency_hist10:55:011
4131617993925,10cyclictest182396-21base6411:15:011
413161299392,24cyclictest0-21swapper/011:30:050
413161299391,28cyclictest573-21runrttasks10:29:410
4131622993829,7cyclictest4163214-21awk07:40:002
4131617993831,5cyclictest59166-21apt-get09:12:311
4131617993830,6cyclictest192917-21apt-get11:27:311
413161299388,23cyclictest573-21runrttasks09:09:070
413161299386,24cyclictest573-21runrttasks07:36:130
413161299382,25cyclictest573-21runrttasks07:50:210
413161299382,24cyclictest0-21swapper/008:39:210
413161299382,23cyclictest0-21swapper/009:11:480
4131612993821,15cyclictest4193523-21tr08:12:330
413161299381,27cyclictest573-21runrttasks10:30:420
413161299381,26cyclictest573-21runrttasks08:43:030
413161299381,26cyclictest573-21runrttasks08:43:030
413161299381,24cyclictest573-21runrttasks07:11:530
413161299381,23cyclictest573-21runrttasks10:16:210
413161299381,21cyclictest4188402-21basename08:07:330
413161299380,27cyclictest573-21runrttasks11:41:330
413161299380,25cyclictest573-21runrttasks09:35:360
413161299372,27cyclictest0-21swapper/010:02:320
413161299372,25cyclictest0-21swapper/010:57:020
413161299372,23cyclictest0-21swapper/010:53:130
413161299371,25cyclictest573-21runrttasks09:53:500
413161299371,25cyclictest573-21runrttasks07:40:100
413161299371,23cyclictest573-21runrttasks08:51:170
413161299370,27cyclictest573-21runrttasks11:37:190
413161299370,27cyclictest132734-21taskset10:23:350
413161299370,26cyclictest573-21runrttasks08:48:320
413161299370,24cyclictest573-21runrttasks11:26:400
413161299370,24cyclictest573-21runrttasks10:14:480
4131617993630,4cyclictest231523-21ntpq12:02:451
4131617993630,4cyclictest118026-21kworker/u8:3+flush-8:010:32:391
4131617993628,6cyclictest88323-21latency_hist09:40:011
4131617993628,6cyclictest4131486-21kworker/u8:3+events_unbound07:42:351
4131617993628,6cyclictest242341-21kworker/u8:2+flush-8:012:22:491
413161299362,23cyclictest0-21swapper/010:40:050
413161299362,23cyclictest0-21swapper/010:40:050
413161299360,23cyclictest573-21runrttasks11:00:270
413161299360,23cyclictest573-21runrttasks09:22:190
413161299360,23cyclictest573-21runrttasks08:28:140
413161299360,22cyclictest573-21runrttasks08:21:030
413161299360,22cyclictest573-21runrttasks07:33:440
4131617993532,2cyclictest0-21swapper/112:37:421
4131617993530,4cyclictest202576-21kworker/u8:1+flush-8:011:52:361
413161299353,17cyclictest0-21swapper/011:48:230
413161299352,22cyclictest0-21swapper/012:02:030
413161299352,22cyclictest0-21swapper/008:00:330
413161299352,17cyclictest0-21swapper/011:56:050
413161299351,22cyclictest573-21runrttasks12:32:570
413161299351,22cyclictest573-21runrttasks12:28:120
413161299351,21cyclictest573-21runrttasks10:48:270
413161299350,23cyclictest573-21runrttasks12:14:430
413161299350,22cyclictest573-21runrttasks12:17:240
413161299350,22cyclictest573-21runrttasks09:56:510
413161299350,22cyclictest573-21runrttasks07:25:570
4131622993425,7cyclictest49013-21apt-get09:02:312
4131617993429,4cyclictest242341-21kworker/u8:2+events_unbound12:32:371
4131617993428,5cyclictest22904-21kworker/u8:0+flush-8:009:42:451
4131617993428,4cyclictest222567-21apt-get11:57:311
4131617993426,6cyclictest4153722-21apt-get07:32:311
413161299342,16cyclictest0-21swapper/012:20:410
413161299340,21cyclictest573-21runrttasks08:15:090
4131622993328,4cyclictest167150-21kworker/u8:3+flush-8:011:22:362
4131617993328,4cyclictest4110975-21kworker/u8:2+flush-8:007:17:421
4131617993324,7cyclictest97471-21ntpq09:47:441
4131617993227,4cyclictest196773-21kworker/u8:2+flush-8:011:32:481
4131617993225,5cyclictest4366-21tr08:17:311
4131617993223,6cyclictest4110975-21kworker/u8:2+flush-8:007:27:361
702432310,5sleep30-21swapper/309:22:393
4131617993124,6cyclictest22904-21kworker/u8:0+events_unbound10:27:411
4131617993123,6cyclictest83410-21latency_hist09:35:011
4131617993123,6cyclictest128150-21kworker/u8:2+flush-8:010:47:321
4131617993123,5cyclictest4173108-21latency_hist07:50:011
328982310,2chrt575-21kworker/3:2+events08:42:423
328982310,2chrt575-21kworker/3:2+events08:42:423
4131622993026,3cyclictest157332-21unixbench_multi10:47:482
4131622993020,8cyclictest222116-21cron11:55:002
4131617993025,3cyclictest98492-21kworker/u8:1+flush-8:009:52:521
4131617993025,3cyclictest110724-21kthreadcore10:02:401
4131617993023,5cyclictest98492-21kworker/u8:1+events_unbound10:17:351
4131617993023,5cyclictest152400-21grep10:42:521
4131617993023,5cyclictest152400-21grep10:42:521
4131617993022,6cyclictest202576-21kworker/u8:1+flush-8:012:07:461
4131617993021,7cyclictest4131952-21apt-get07:12:301
413161799300,28cyclictest1-21systemd08:05:001
4131622992924,4cyclictest167150-21kworker/u8:3+flush-8:011:12:402
4131622992924,3cyclictest64322-21cpuspeed_turbos09:17:352
4131617992924,4cyclictest98492-21kworker/u8:1+events_unbound10:07:341
4131617992924,4cyclictest43429-21kworker/u8:3+events_unbound09:17:351
4131622992824,2cyclictest4192586-21unixbench_multi08:07:512
4131617992823,3cyclictest43429-21kworker/u8:3+flush-8:009:22:331
4131617992823,3cyclictest4153532-21kworker/u8:1+flush-8:007:52:451
4131617992822,3cyclictest0-21swapper/111:50:001
4131622992716,8cyclictest118188-21cat10:10:012
4131617992723,3cyclictest167150-21kworker/u8:3+flush-8:011:42:361
4131617992723,2cyclictest168625-21irqrtprio11:02:371
4131617992722,4cyclictest128150-21kworker/u8:2+flush-8:010:35:591
4131617992721,4cyclictest4189114-21irqrtprio08:07:381
4131617992720,5cyclictest28521-21unixbench_singl08:37:501
4131617992716,8cyclictest32944-21ntpq08:42:431
4131617992716,8cyclictest32944-21ntpq08:42:431
41274702273,4sleep10-21swapper/107:07:381
4131622992621,3cyclictest73259-21unixbench_multi09:22:512
4131622992621,3cyclictest118507-21aten2_r5power_e10:12:342
4131622992620,4cyclictest4182776-21unixbench_singl07:57:512
4131617992622,3cyclictest20823-21cron08:00:001
4131617992621,3cyclictest42789-21needreboot08:52:431
4131617992620,4cyclictest167150-21kworker/u8:3+events_unbound12:12:361
41454812250,3sleep3471rcuc/307:22:403
4131622992520,4cyclictest142955-21kworker/u8:1+flush-8:010:57:492
4131622992520,3cyclictest39324-21cpuspeed_turbos08:52:342
4131617992520,3cyclictest4144602-21irqrtprio07:22:391
4131617992520,3cyclictest23468-21sed08:32:511
4131617992519,4cyclictest22904-21kworker/u8:0+flush-8:009:57:451
413161299251,20cyclictest4131607-21cyclictest07:10:010
4131622992421,2cyclictest4193519-21cpuspeed_turbos08:12:332
4131622992420,3cyclictest212920-21cpuspeed_turbos11:47:342
4131622992420,2cyclictest208079-21fschecks_time11:42:352
413162299241,8cyclictest1314642cut10:22:412
4131617992418,5cyclictest22904-21kworker/u8:0+events_unbound08:57:451
4131617992418,5cyclictest167150-21kworker/u8:3+flush-8:011:37:391
4131617992418,4cyclictest167150-21kworker/u8:3+events_unbound11:22:351
4131622992320,2cyclictest158324-21fschecks_count10:52:362
4131622992319,2cyclictest168011-21aten2_r5power_v11:02:322
4131622992318,4cyclictest3676-21kworker/u8:1+flush-8:008:22:492
4131622992317,5cyclictest4152999-21unixbench_multi07:27:512
4131622992315,6cyclictest143459-21fschecks_count10:37:362
4131622992314,7cyclictest182957-21munin-node11:17:302
4131617992318,3cyclictest119168-21irqrtprio10:12:391
4131617992317,4cyclictest4178269-21kworker/u8:2+events_unbound08:12:351
4131622992219,2cyclictest227974-21cpuspeed_turbos12:02:352
4131622992218,3cyclictest4143988-21aten2_r5power_v07:22:342
4131622992218,2cyclictest0-21swapper/209:35:002
4131622992217,4cyclictest4131486-21kworker/u8:3+events_unbound08:42:462
4131622992217,4cyclictest4131486-21kworker/u8:3+events_unbound08:42:462
4131622992217,3cyclictest88086-21unixbench_singl09:37:522
4131622992217,3cyclictest232740-21aten2_r5power_c12:07:332
4131622992216,4cyclictest197376-21cron11:30:002
4131622992215,5cyclictest28974-21kworker/u8:1+flush-8:008:48:012
4131622992214,6cyclictest238542-21kthreadcore12:12:392
413162299220,10cyclictest257922grep08:37:392
4131617992216,4cyclictest22904-21kworker/u8:0+events_unbound09:28:091
4131617992216,4cyclictest128150-21kworker/u8:2+events_unbound11:07:451
4131622992118,2cyclictest74251-21cpuspeed_turbos09:28:082
4131622992118,2cyclictest152446-21grep10:42:522
4131622992118,2cyclictest152446-21grep10:42:522
4131622992117,3cyclictest227582-21kworker/u8:0+flush-8:012:27:402
4131622992117,2cyclictest0-21swapper/208:05:002
4131622992116,4cyclictest216991-21kworker/u8:2+flush-8:011:57:482
4131622992116,3cyclictest142499-21unixbench_singl10:32:512
4131622992115,4cyclictest4132170-21cpuspeed_turbos07:12:332
4131622992115,4cyclictest18466-21unixbench_multi08:27:512
4131622992115,4cyclictest176582-21needreboot11:07:422
4131622992110,4cyclictest0-21swapper/207:32:482
4131617992117,2cyclictest0-21swapper/112:27:321
413162299202,13cyclictest4138898-21apt-get07:17:322
4131622992016,3cyclictest261663-21unixbench_singl12:32:492
4131622992016,3cyclictest20823-21cron10:20:002
4131622992016,2cyclictest0-21swapper/209:10:012
4131622992016,2cyclictest0-21swapper/207:42:432
4131622992015,3cyclictest202123-21unixbench_singl11:32:512
4131622992014,4cyclictest4168838-21cpuspeed_turbos07:47:332
4131622991915,2cyclictest0-21swapper/208:17:462
4131622991912,5cyclictest63658-21sh09:15:002
41305432194,9sleep20-21swapper/207:07:432
41273582193,9sleep30-21swapper/307:07:363
4131622991814,2cyclictest4173815-21fschecks_count07:52:362
4131622991814,2cyclictest0-21swapper/209:57:502
4131622991813,3cyclictest0-21swapper/209:52:422
4131622991812,4cyclictest0-21swapper/210:02:392
1735892187,6sleep30-21swapper/311:07:393
4131622991712,3cyclictest0-21swapper/209:42:472
4131622991613,1cyclictest0-21swapper/209:47:522
4131622991510,3cyclictest0-21swapper/211:37:412
1978022156,5sleep30-21swapper/311:32:313
4131622991410,2cyclictest133563-21fschecks_count10:27:362
31292142,8sleep30-21swapper/308:12:463
41830432132,6sleep30-21swapper/308:00:013
41691002132,7sleep30-21swapper/307:47:373
2322882132,6sleep30-21swapper/312:05:013
2316142132,7sleep30-21swapper/312:02:493
2220552136,5sleep30-21swapper/311:54:183
1293842132,7sleep30-21swapper/310:22:403
1233912132,7sleep30-21swapper/310:17:343
982542122,5sleep30-21swapper/309:50:013
935512122,6sleep30-21swapper/309:45:283
636962122,6sleep30-21swapper/309:15:023
578212122,6sleep30-21swapper/309:07:483
439272122,6sleep30-21swapper/308:56:283
435372122,6sleep30-21swapper/308:54:273
41883902122,6sleep30-21swapper/308:07:323
41634702122,7sleep30-21swapper/307:40:273
41582512122,5sleep30-21swapper/307:35:013
41574332124,5sleep30-21swapper/307:32:453
41324642122,6sleep30-21swapper/307:12:383
380402122,6sleep30-21swapper/308:47:493
2623122122,6sleep30-21swapper/312:37:323
2569712122,5sleep30-21swapper/312:30:013
2566422122,6sleep30-21swapper/312:27:533
2518932122,6sleep30-21swapper/312:23:273
2463642122,6sleep30-21swapper/312:17:453
241582122,6sleep30-21swapper/308:37:303
2375622125,5sleep30-21swapper/312:12:083
229632122,6sleep30-21swapper/308:32:443
2171552122,6sleep30-21swapper/311:50:003
2082352122,6sleep30-21swapper/311:42:383
2026022122,6sleep30-21swapper/311:35:273
1931722123,5sleep30-21swapper/311:27:373
1822902122,6sleep30-21swapper/311:15:013
1584422122,6sleep30-21swapper/310:52:383
91202112,6sleep30-21swapper/308:20:283
886442112,6sleep30-21swapper/309:41:063
842212112,5sleep30-21swapper/309:37:373
788662112,5sleep30-21swapper/309:32:323
738562112,6sleep30-21swapper/309:26:173
589652112,6sleep30-21swapper/309:10:163
529032112,6sleep30-21swapper/309:02:503
41783732113,5sleep30-21swapper/307:56:283
41733292112,5sleep30-21swapper/307:50:023
41493182112,5sleep30-21swapper/307:27:393
41368672112,5sleep30-21swapper/307:15:033
40632112,5sleep30-21swapper/308:15:023
2225392112,5sleep30-21swapper/311:57:313
1924192112,6sleep30-21swapper/311:24:283
1869422112,5sleep30-21swapper/311:17:503
1677622113,5sleep30-21swapper/311:01:043
1660662112,5sleep30-21swapper/310:57:433
1529522113,5sleep30-21swapper/310:45:553
1480412112,6sleep30-21swapper/310:41:143
1480412112,6sleep30-21swapper/310:41:143
1430602112,6sleep30-21swapper/310:36:283
140112112,5sleep30-21swapper/308:25:023
1380372112,5sleep30-21swapper/310:30:023
1183142112,6sleep30-21swapper/310:11:083
1090162112,5sleep30-21swapper/310:02:373
1036242112,6sleep30-21swapper/309:57:323
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional