You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-12 - 18:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Wed Aug 12, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4868599204199,3cyclictest213225-21strings09:52:552
4868599193183,7cyclictest291675-21cut11:12:522
4868299155151,2cyclictest0-21swapper/109:52:551
4868099145128,15cyclictest0-21swapper/009:52:550
4868299138132,3cyclictest291676-21tr11:12:521
4868099130112,16cyclictest0-21swapper/011:12:520
27682921000,6chrt0-21swapper/210:57:532
48682995752,4cyclictest249004-21kworker/u8:0+flush-8:010:43:001
48682995651,3cyclictest4194100-21kworker/u8:1+events_unbound07:27:471
48682995549,4cyclictest268996-21kworker/u8:3+events_unbound12:17:511
48682995448,4cyclictest298917-21kworker/u8:1+events_unbound11:58:031
48682995348,4cyclictest298917-21kworker/u8:1+events_unbound12:02:581
48682995248,2cyclictest174743-21kworker/u8:0+events_unbound09:22:481
48682995246,5cyclictest114716-21kworker/u8:0+flush-8:008:22:481
48682995246,4cyclictest4194100-21kworker/u8:1+flush-8:007:15:051
48682995243,6cyclictest174494-21latency_hist09:15:011
48682995145,4cyclictest298917-21kworker/u8:1+flush-8:012:08:021
48680995144,5cyclictest367874-21latency_hist12:30:010
48682994944,4cyclictest234101-21kworker/u8:2+flush-8:011:38:001
48682994943,5cyclictest85220-21kworker/u8:0+events_unbound07:58:011
48680994939,8cyclictest275-21systemd-journal09:25:010
48685994840,6cyclictest275-21systemd-journal12:10:002
48682994843,4cyclictest234101-21kworker/u8:2+events_unbound10:32:471
48682994743,3cyclictest268996-21kworker/u8:3+flush-8:011:05:161
48682994742,4cyclictest114716-21kworker/u8:0+events_unbound08:17:501
48682994742,3cyclictest75530-21kworker/u8:3+events_unbound08:27:461
48682994741,5cyclictest125044-21kworker/u8:1+flush-8:009:17:501
48682994739,6cyclictest308990-21/usr/sbin/munin11:33:011
48682994738,7cyclictest3447475-21kworker/u8:0+flush-8:007:33:021
48682994737,7cyclictest248262-21ntpq10:27:581
48682994642,3cyclictest298917-21kworker/u8:1+events_unbound11:47:461
48682994640,5cyclictest125044-21kworker/u8:1+flush-8:009:57:561
48682994640,4cyclictest174743-21kworker/u8:0+flush-8:009:48:001
48682994635,9cyclictest249004-21kworker/u8:0+events_unbound10:47:491
48682994540,4cyclictest239122-21kworker/u8:1+events_unbound10:22:561
48682994540,4cyclictest239122-21kworker/u8:1+events_unbound10:22:561
48680994539,4cyclictest85220-21kworker/u8:0+flush-8:007:55:160
48680994535,8cyclictest125736-21diskstats08:27:480
48680994534,9cyclictest149047-21ntpq08:47:560
48682994438,5cyclictest239122-21kworker/u8:1+flush-8:010:52:571
48682994438,5cyclictest184355-21kworker/u8:2+events_unbound09:37:471
48682994438,4cyclictest3447475-21kworker/u8:0+events_unbound07:23:011
48682994438,4cyclictest125044-21kworker/u8:1+flush-8:010:07:481
48682994437,5cyclictest249004-21kworker/u8:0+flush-8:010:37:541
48682994339,3cyclictest234101-21kworker/u8:2+events_unbound11:15:511
48682994338,4cyclictest298917-21kworker/u8:1+events_unbound12:37:561
48682994337,4cyclictest75530-21kworker/u8:3+events_unbound07:42:451
48682994337,4cyclictest125044-21kworker/u8:1+events_unbound08:57:451
48685994212,13cyclictest348569-21apt-get12:12:492
48685994212,13cyclictest348569-21apt-get12:12:482
48682994237,4cyclictest268996-21kworker/u8:3+flush-8:010:57:511
48682994237,3cyclictest75530-21kworker/u8:3+flush-8:007:37:511
48682994237,3cyclictest174743-21kworker/u8:0+events_unbound09:27:471
48682994235,5cyclictest85220-21kworker/u8:0+flush-8:007:47:551
48682994136,4cyclictest125044-21kworker/u8:1+flush-8:010:02:471
48682994136,4cyclictest125044-21kworker/u8:1+flush-8:009:07:501
48682994036,3cyclictest75530-21kworker/u8:3+events_unbound08:13:021
48682994035,4cyclictest298917-21kworker/u8:1+events_unbound12:27:551
48682994035,3cyclictest174743-21kworker/u8:0+events_unbound09:32:511
48682994033,5cyclictest114716-21kworker/u8:0+flush-8:008:32:571
48682994030,7cyclictest275-21systemd-journal09:05:001
48682994030,7cyclictest105395-21/usr/sbin/munin08:08:011
48680994032,6cyclictest288779-21latency_hist11:10:010
48680994031,7cyclictest189755-21/usr/sbin/munin09:32:540
48680994029,8cyclictest243815-21apt10:25:000
48680994029,8cyclictest243815-21apt10:25:000
4838024027,9sleep20-21swapper/207:08:402
48682993933,5cyclictest323410-21kworker/u8:0+flush-8:011:53:031
48682993933,4cyclictest298917-21kworker/u8:1+flush-8:012:22:501
2071492390,6sleep20-21swapper/209:47:512
48680993833,3cyclictest174743-21kworker/u8:0+flush-8:009:27:510
484562384,9sleep10-21swapper/107:09:381
48682993733,3cyclictest145101-21kworker/u8:3+flush-8:008:53:021
48680993733,3cyclictest114716-21kworker/u8:0+events_unbound08:33:000
874242360,2sleep3471rcuc/307:47:513
48682993630,5cyclictest234101-21kworker/u8:2+flush-8:011:03:031
48682993630,4cyclictest4194100-21kworker/u8:1+events_unbound07:52:591
48682993629,5cyclictest114716-21kworker/u8:0+events_unbound08:37:461
48680993632,3cyclictest4194100-21kworker/u8:1+flush-8:008:08:040
48680993630,4cyclictest298917-21kworker/u8:1+flush-8:012:32:490
48680993629,6cyclictest85220-21kworker/u8:0+flush-8:008:02:590
48680993628,6cyclictest275-21systemd-journal07:20:010
48682993530,3cyclictest298917-21kworker/u8:1+flush-8:011:27:571
48682993529,5cyclictest85220-21kworker/u8:0+events_unbound08:02:561
48682993529,4cyclictest234101-21kworker/u8:2+flush-8:010:17:491
48682993529,4cyclictest234101-21kworker/u8:2+flush-8:010:17:491
48680993529,4cyclictest199194-21latency_hist09:40:010
48680993526,7cyclictest275-21systemd-journal12:40:000
48680993430,3cyclictest4194100-21kworker/u8:1+flush-8:007:47:590
48680993430,3cyclictest120078-21latency_hist08:20:010
48680993429,4cyclictest75530-21kworker/u8:3+flush-8:007:35:310
48680993425,7cyclictest304054-21/usr/sbin/munin11:28:000
48680993424,7cyclictest238839-21latency_hist10:20:000
48680993424,7cyclictest238839-21latency_hist10:20:000
48685993325,6cyclictest275-21systemd-journal09:45:002
48685993323,8cyclictest288776-21turbostat.cron11:10:002
48685993318,9cyclictest219479-21apt-get10:02:432
48682993329,3cyclictest268996-21kworker/u8:3+flush-8:011:42:571
48682993328,4cyclictest125044-21kworker/u8:1+events_unbound08:47:481
48682993327,5cyclictest228955-21kworker/u8:0+events_unbound10:15:011
48680993329,3cyclictest125044-21kworker/u8:1+flush-8:009:16:200
48680993328,4cyclictest114716-21kworker/u8:0+events_unbound08:22:450
4868599324,14cyclictest363045-21sed12:25:012
48685993222,4cyclictest179910-21apt-get09:22:432
48682993228,3cyclictest4194100-21kworker/u8:1+events_unbound07:12:581
48682993225,5cyclictest323410-21kworker/u8:0+flush-8:012:32:541
48680993228,3cyclictest239122-21kworker/u8:1+flush-8:010:48:010
48680993226,4cyclictest125044-21kworker/u8:1+events_unbound09:57:460
4868099320,30cyclictest1-21systemd09:49:140
4868599317,12cyclictest104073-21memory08:02:532
48685993116,10cyclictest224462-21apt-get10:07:452
48680993126,3cyclictest298917-21kworker/u8:1+flush-8:011:40:050
48680993126,3cyclictest268996-21kworker/u8:3+flush-8:012:07:250
48680993121,7cyclictest275-21systemd-journal07:15:010
4868599308,12cyclictest328226-21sshd11:48:162
4868599308,11cyclictest149138-21ntp_states08:47:592
48685993021,4cyclictest120550-21apt-get08:22:442
48685993018,8cyclictest55228-21ntpq07:15:032
48685993018,8cyclictest198504-21ntpq09:37:572
48685993015,11cyclictest368817-21/usr/sbin/munin12:32:472
48682993026,3cyclictest174743-21kworker/u8:0+events_unbound09:43:051
4868099301,27cyclictest174512-21true09:15:010
478842305,7sleep013-21ksoftirqd/007:08:000
4868599299,5cyclictest163931-21ntpq09:02:582
48685992921,4cyclictest70809-21apt-get07:32:442
48685992920,4cyclictest373267-21apt-get12:37:442
48685992920,4cyclictest294170-21apt-get11:17:422
48685992920,4cyclictest254400-21apt-get10:37:432
48685992920,4cyclictest155163-21apt-get08:57:442
48685992920,4cyclictest135404-21apt-get08:37:442
48680992925,3cyclictest4194100-21kworker/u8:1+flush-8:008:13:070
48680992925,3cyclictest268996-21kworker/u8:3+flush-8:011:17:470
48680992924,3cyclictest4194100-21kworker/u8:1+flush-8:007:53:030
48680992922,5cyclictest125044-21kworker/u8:1+events_unbound10:07:570
48680992921,6cyclictest303620-21latency_hist11:25:010
48680992920,6cyclictest169059-21python309:08:000
48685992824,2cyclictest239665-21fschecks_time10:22:472
48685992824,2cyclictest239665-21fschecks_time10:22:472
48685992819,7cyclictest275-21systemd-journal09:19:152
48685992819,5cyclictest259357-21apt-get10:42:432
48685992819,4cyclictest49020-21apt-get07:12:432
48685992814,11cyclictest189594-21seq09:30:362
48685992813,10cyclictest363370-21apt-get12:27:442
48682992824,3cyclictest268996-21kworker/u8:3+events_unbound12:14:501
48682992824,3cyclictest268996-21kworker/u8:3+events_unbound12:14:501
48682992823,3cyclictest298917-21kworker/u8:1+events_unbound11:23:021
48682992823,3cyclictest114716-21kworker/u8:0+events_unbound08:40:331
48680992824,3cyclictest298917-21kworker/u8:1+flush-8:011:47:530
48680992823,3cyclictest125044-21kworker/u8:1+events_unbound08:52:450
48685992723,2cyclictest185161-21fschecks_time09:27:472
48685992720,4cyclictest154051-21ntpq08:52:572
48685992717,5cyclictest309017-21apt-get11:32:432
48685992717,5cyclictest249445-21apt-get10:32:442
48685992715,9cyclictest354217-21ps12:17:512
48685992715,9cyclictest342306-21/usr/sbin/munin12:02:512
48685992715,8cyclictest64722-21ntpq07:22:562
48685992715,10cyclictest337619-21/usr/sbin/munin11:58:002
4868099272,4cyclictest0-21swapper/010:50:470
48680992723,3cyclictest125044-21kworker/u8:1+events_unbound10:02:500
48680992723,3cyclictest125044-21kworker/u8:1+events_unbound09:40:330
48680992722,4cyclictest75530-21kworker/u8:3+flush-8:007:43:040
48680992722,4cyclictest234101-21kworker/u8:2+events_unbound11:37:590
48680992722,3cyclictest125044-21kworker/u8:1+events_unbound08:57:470
48680992719,6cyclictest75273-21latency_hist07:35:000
48680992718,2cyclictest161rcu_preempt10:30:000
16037122716,7sleep30-21swapper/309:02:473
48685992622,2cyclictest264606-21fschecks_time10:47:462
48685992622,2cyclictest165137-21aten2_r5power_p09:07:432
48685992618,4cyclictest218531-21python309:58:012
48685992617,7cyclictest87811-21/usr/sbin/munin07:47:512
48685992616,7cyclictest81178-21/usr/sbin/munin07:42:482
48685992615,8cyclictest115822-21/usr/sbin/munin08:17:492
48685992615,7cyclictest66059-21/usr/sbin/munin07:27:462
48685992614,9cyclictest140356-21/usr/sbin/munin08:42:422
48685992611,12cyclictest90365-21chrt07:50:072
48685992610,3cyclictest3165262tr11:37:522
48680992621,4cyclictest3447475-21kworker/u8:0+events_unbound07:22:590
48680992621,4cyclictest268996-21kworker/u8:3+events_unbound12:12:520
48680992621,4cyclictest268996-21kworker/u8:3+events_unbound12:12:520
48680992621,3cyclictest263828-21cron10:45:000
48680992621,3cyclictest0-21swapper/012:05:000
48685992521,2cyclictest299391-21fschecks_count11:22:462
48685992519,4cyclictest283858-21apt-key11:05:012
48685992516,7cyclictest99338-21/usr/sbin/munin07:57:582
48685992516,7cyclictest248296-21ntpq10:27:592
48685992515,8cyclictest234579-21/usr/sbin/munin10:17:452
48685992515,8cyclictest234579-21/usr/sbin/munin10:17:452
48685992514,8cyclictest169828-21taskset09:10:532
48685992510,4cyclictest129349-21ntpq08:28:012
48680992522,2cyclictest253748-21unixbench_singl10:33:040
48680992520,4cyclictest268996-21kworker/u8:3+flush-8:010:58:030
48680992518,6cyclictest114716-21kworker/u8:0+events_unbound08:40:000
48685992415,7cyclictest332824-21/usr/sbin/munin11:53:022
48685992415,7cyclictest113926-21/usr/sbin/munin08:12:542
48685992414,7cyclictest269577-21/usr/sbin/munin10:52:492
48685992412,8cyclictest1-21systemd08:06:092
48685992410,12cyclictest134871-21chrt08:34:122
48680992420,3cyclictest268996-21kworker/u8:3+events_unbound11:32:450
48680992420,3cyclictest0-21swapper/010:40:000
48680992419,4cyclictest323410-21kworker/u8:0+events_unbound12:23:040
48680992419,3cyclictest0-21swapper/009:05:000
48685992314,6cyclictest79538-21/usr/sbin/munin07:37:572
48685992312,9cyclictest322648-21ntpq11:42:562
48685992311,9cyclictest303872-21taskset11:25:212
48685992310,10cyclictest229212-21chrt10:10:392
4868099234,13cyclictest571-21snmpd11:57:440
48680992319,3cyclictest268996-21kworker/u8:3+events_unbound11:52:470
48680992319,2cyclictest0-21swapper/007:30:000
48680992317,4cyclictest268996-21kworker/u8:3+events_unbound12:17:470
48680992218,3cyclictest234101-21kworker/u8:2+events_unbound11:02:490
48680992218,3cyclictest125044-21kworker/u8:1+events_unbound10:10:390
48680992117,3cyclictest130229-21kworker/u8:2+flush-8:008:41:200
484162193,9sleep30-21swapper/307:09:083
962712150,2sleep3471rcuc/307:57:513
943592132,7sleep30-21swapper/307:52:583
3485432132,7sleep30-21swapper/312:12:473
3485432132,7sleep30-21swapper/312:12:473
3085782132,6sleep30-21swapper/311:30:013
2910792130,9sleep30-21swapper/311:12:523
2233492134,5sleep30-21swapper/310:02:593
654282122,5sleep30-21swapper/307:25:013
490992122,6sleep30-21swapper/307:12:453
3728312122,6sleep30-21swapper/312:35:023
3688502122,5sleep30-21swapper/312:32:493
3589072122,6sleep30-21swapper/312:22:503
3571742122,6sleep30-21swapper/312:17:563
3425102123,5sleep30-21swapper/312:02:563
3333072122,5sleep30-21swapper/311:55:013
3247322122,6sleep30-21swapper/311:47:513
3226602123,6sleep30-21swapper/311:42:573
3139612122,6sleep30-21swapper/311:37:443
3065702120,2sleep3471rcuc/311:27:533
3033742122,6sleep30-21swapper/311:23:033
2973262122,6sleep30-21swapper/311:17:533
2842812122,6sleep30-21swapper/311:07:463
2719872122,6sleep30-21swapper/310:52:543
2641532122,6sleep30-21swapper/310:46:163
2494192122,6sleep30-21swapper/310:32:433
2456312121,7sleep30-21swapper/310:27:543
2294002122,6sleep30-21swapper/310:12:453
2281502122,6sleep30-21swapper/310:07:563
2033892122,6sleep30-21swapper/309:42:563
1942782122,5sleep30-21swapper/309:35:013
1898132122,6sleep30-21swapper/309:32:453
1888912123,5sleep30-21swapper/309:28:033
1800722122,6sleep30-21swapper/309:22:463
1748132122,6sleep30-21swapper/309:16:163
1699942125,4sleep30-21swapper/309:12:423
1500322122,6sleep30-21swapper/308:50:153
1392642122,6sleep30-21swapper/308:38:003
1300002122,5sleep30-21swapper/308:30:013
1257292122,6sleep30-21swapper/308:27:483
1157942122,6sleep30-21swapper/308:17:493
1111202122,7sleep30-21swapper/308:12:533
1049742122,5sleep30-21swapper/308:05:013
809732112,5sleep30-21swapper/307:42:463
776942111,6sleep30-21swapper/307:37:533
752612112,5sleep30-21swapper/307:35:003
607102112,6sleep30-21swapper/307:20:233
555232112,5sleep30-21swapper/307:15:063
3633442112,5sleep30-21swapper/312:27:433
3445422112,5sleep30-21swapper/312:07:533
3286272112,5sleep30-21swapper/311:50:283
2789252112,5sleep30-21swapper/311:00:443
2739162112,5sleep30-21swapper/310:55:023
2636842112,5sleep30-21swapper/310:43:153
2546362112,5sleep30-21swapper/310:37:453
2396422112,6sleep30-21swapper/310:22:483
2396422112,6sleep30-21swapper/310:22:483
2341662112,5sleep30-21swapper/310:15:553
2341662112,5sleep30-21swapper/310:15:543
2144822112,5sleep30-21swapper/309:57:453
2093292112,5sleep30-21swapper/309:50:023
2045802112,5sleep30-21swapper/309:47:423
1547282112,5sleep30-21swapper/308:55:013
1450582112,5sleep30-21swapper/308:45:023
1408512112,5sleep30-21swapper/308:42:493
1203032110,6sleep30-21swapper/308:20:023
1044812112,5sleep30-21swapper/308:03:013
1648192102,5sleep30-21swapper/309:05:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional