You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-01 - 16:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Fri May 01, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
71472821940,3sleep375-21kworker/3:1-events07:46:173
6731232630,7chrt291ktimers/107:06:181
673960996255,5cyclictest809701-21kworker/u8:3+events_unbound11:21:181
673960996154,5cyclictest673823-21kworker/u8:1+flush-8:007:16:201
673960996053,4cyclictest948308-21kworker/u8:2+flush-8:011:46:031
673960996052,6cyclictest3518702-21kworker/u8:2+flush-8:008:11:201
673960995954,4cyclictest809701-21kworker/u8:3+events_unbound09:26:021
673960995952,5cyclictest884808-21kworker/u8:1+flush-8:011:26:031
673960995952,5cyclictest685357-21kworker/u8:0+flush-8:010:26:151
673960995950,5cyclictest809701-21kworker/u8:3+flush-8:009:46:141
673958995949,7cyclictest978978-21latency_hist12:15:010
673960995852,4cyclictest685357-21kworker/u8:0+events_unbound07:56:151
673960995852,4cyclictest616888-21kworker/u8:3+flush-8:007:31:141
673960995851,5cyclictest685357-21kworker/u8:0+flush-8:008:51:191
673958995645,8cyclictest685357-21kworker/u8:0+flush-8:007:21:150
673964995447,5cyclictest909285-21apt-get11:05:012
673960995448,5cyclictest809701-21kworker/u8:3+events_unbound10:11:041
673960995448,4cyclictest685357-21kworker/u8:0+flush-8:008:16:131
673960995448,4cyclictest3518702-21kworker/u8:2+flush-8:009:21:141
673960995447,5cyclictest685357-21kworker/u8:0+flush-8:009:31:171
673960995446,6cyclictest948308-21kworker/u8:2+flush-8:012:26:121
673964995342,8cyclictest280-21systemd-journal09:20:012
673960995346,5cyclictest809701-21kworker/u8:3+events_unbound10:51:051
673958995345,5cyclictest919308-21base6411:15:010
673960995248,3cyclictest3518702-21kworker/u8:2+flush-8:008:01:121
673960995247,3cyclictest884808-21kworker/u8:1+events_unbound11:16:161
673960995247,3cyclictest809701-21kworker/u8:3+events_unbound09:51:141
673960995245,5cyclictest3518702-21kworker/u8:2+flush-8:008:21:151
7772732510,2sleep375-21kworker/3:1+events08:51:103
673960995146,2cyclictest685357-21kworker/u8:0+events_unbound10:06:031
673960995145,4cyclictest3518702-21kworker/u8:2+events_unbound07:11:151
673960995143,6cyclictest849290-21kworker/u8:2+events_unbound10:31:171
673958995145,4cyclictest884808-21kworker/u8:1+flush-8:010:46:140
673958995145,4cyclictest884808-21kworker/u8:1+flush-8:010:46:130
673964995039,8cyclictest838842-21ntpq09:51:142
673960995046,3cyclictest884808-21kworker/u8:1+flush-8:010:56:121
673960995043,5cyclictest3518702-21kworker/u8:2+flush-8:008:35:011
673960995043,5cyclictest3518702-21kworker/u8:2+flush-8:008:35:011
673958995043,5cyclictest948308-21kworker/u8:2+flush-8:012:26:140
673960994944,3cyclictest884808-21kworker/u8:1+flush-8:012:11:201
673960994943,4cyclictest685357-21kworker/u8:0+events_unbound09:36:041
673960994942,5cyclictest948308-21kworker/u8:2+events_unbound11:51:181
673960994942,5cyclictest3518702-21kworker/u8:2+flush-8:008:36:151
673960994843,4cyclictest725546-21kworker/u8:1+events_unbound08:41:031
673960994842,5cyclictest725546-21kworker/u8:1+events_unbound09:01:161
673960994842,4cyclictest994054-21kworker/u8:0+events_unbound12:35:021
673960994842,4cyclictest725546-21kworker/u8:1+flush-8:009:41:051
673958994841,5cyclictest948308-21kworker/u8:2+flush-8:011:51:120
673958994841,5cyclictest849585-21http10:05:010
673960994741,5cyclictest3518702-21kworker/u8:2+events_unbound08:06:161
673960994741,4cyclictest884808-21kworker/u8:1+flush-8:011:06:071
673960994740,5cyclictest884808-21kworker/u8:1+flush-8:011:36:181
673960994740,5cyclictest809701-21kworker/u8:3+events_unbound11:11:151
673958994738,6cyclictest705480-21latency_hist07:40:010
673958994639,5cyclictest923545-21ntpq11:16:130
673960994539,4cyclictest685357-21kworker/u8:0+events_unbound07:41:141
8468482440,2sleep3481ktimers/310:01:083
673960994439,4cyclictest969082-21kworker/u8:3+flush-8:012:31:201
673960994438,5cyclictest884808-21kworker/u8:1+events_unbound11:31:131
673960994438,4cyclictest849290-21kworker/u8:2+flush-8:010:36:101
673958994437,4cyclictest984154-21latency_hist12:20:010
673960994333,7cyclictest849565-21latency_hist10:05:011
673960994236,4cyclictest948308-21kworker/u8:2+flush-8:012:21:041
673960994236,4cyclictest805014-21latency_hist09:20:001
673960994235,5cyclictest685357-21kworker/u8:0+flush-8:007:21:091
673960994034,4cyclictest725546-21kworker/u8:1+events_unbound09:06:171
673960994033,5cyclictest884808-21kworker/u8:1+events_unbound12:16:031
673964993928,8cyclictest780883-21diskstats08:56:042
673960993933,4cyclictest616888-21kworker/u8:3+flush-8:007:36:191
673960993833,4cyclictest884808-21kworker/u8:1+flush-8:010:46:131
673960993833,4cyclictest884808-21kworker/u8:1+flush-8:010:46:131
673960993829,7cyclictest963024-21ntpq11:56:121
67396499378,13cyclictest8838632tr10:36:162
673964993731,4cyclictest280-21systemd-journal12:05:002
673960993733,3cyclictest685357-21kworker/u8:0+flush-8:008:56:211
673960993732,3cyclictest809701-21kworker/u8:3+flush-8:010:16:151
673958993731,4cyclictest884808-21kworker/u8:1+flush-8:012:21:190
673958993729,6cyclictest3518702-21kworker/u8:2+flush-8:008:21:060
673960993632,3cyclictest969082-21kworker/u8:3+flush-8:012:06:181
673960993630,4cyclictest840026-21apt-get09:55:581
673958993625,9cyclictest799207-21ntpq09:11:140
673964993527,5cyclictest280-21systemd-journal10:20:002
673964993520,9cyclictest686780-21ps07:21:092
673964993518,10cyclictest979532-21apt-get12:16:022
673960993531,3cyclictest3518702-21kworker/u8:2+flush-8:009:11:061
673960993530,4cyclictest616888-21kworker/u8:3+flush-8:007:26:161
673958993530,4cyclictest3518702-21kworker/u8:2+events_unbound08:36:180
673958993530,3cyclictest809701-21kworker/u8:3+flush-8:009:51:040
673958993528,5cyclictest969152-21/usr/sbin/munin12:06:190
673958993527,6cyclictest280-21systemd-journal11:25:010
673964993419,9cyclictest725853-21apt-get08:00:592
673964993419,9cyclictest695926-21apt-get07:31:022
673958993430,3cyclictest685357-21kworker/u8:0+flush-8:007:56:220
673964993323,8cyclictest938520-21anacron11:31:182
673964993310,21cyclictest924393-21munin-plugin-st11:20:012
673960993329,3cyclictest685357-21kworker/u8:0+events_unbound08:46:081
673960993328,3cyclictest3518702-21kworker/u8:2+events_unbound08:26:111
673960993326,5cyclictest908379-21ntpq11:01:121
673958993326,5cyclictest834350-21grep09:46:190
673964993222,4cyclictest998995-21apt-get12:35:032
673958993227,4cyclictest685357-21kworker/u8:0+flush-8:007:51:050
673964993126,3cyclictest989454-21aten2_r5power_c12:26:022
673964993123,6cyclictest280-21systemd-journal11:30:002
673964993121,5cyclictest764429-21ntpq08:36:132
673964993118,8cyclictest678047-21ntpq07:11:162
673964993110,4cyclictest824029-21ntpq09:36:142
673958993127,3cyclictest725546-21kworker/u8:1+flush-8:008:41:140
673958993126,4cyclictest685357-21kworker/u8:0+flush-8:009:30:010
673958993125,3cyclictest0-21swapper/012:01:120
673958993124,5cyclictest894821-21aten2_r5power_p10:51:020
673958993124,5cyclictest3518702-21kworker/u8:2+flush-8:008:06:150
673958993119,2cyclictest0-21swapper/008:56:150
673964993022,6cyclictest869647-21basename10:25:002
673964993020,5cyclictest850127-21apt-get10:05:592
673964993020,5cyclictest735743-21apt-get08:11:032
673964993019,5cyclictest745612-21apt-get08:21:022
673964993013,10cyclictest855084-21apt-get10:11:022
673960993020,7cyclictest720320-21turbostat.cron07:55:001
673958993026,3cyclictest938928-21kworker/u8:0+flush-8:011:56:140
673958993016,7cyclictest0-21swapper/010:26:130
673964992924,3cyclictest735414-21idleruntime-cro08:10:002
673964992923,4cyclictest885-21mta-sts-daemon11:51:092
673964992919,5cyclictest830161-21apt-get09:46:012
673964992918,7cyclictest963084-21ntpq11:56:142
673960992925,3cyclictest948308-21kworker/u8:2+events_unbound11:43:551
673960992925,3cyclictest938928-21kworker/u8:0+flush-8:012:03:541
673960992925,2cyclictest711063-21cut07:46:031
673958992925,3cyclictest809701-21kworker/u8:3+events_unbound10:11:180
673958992922,5cyclictest849574-21apt-get10:04:590
67396499286,5cyclictest894970-21df10:51:022
673964992814,11cyclictest848895-21/usr/sbin/munin10:01:172
673964992810,4cyclictest948232-21ntpq11:41:112
673958992824,3cyclictest884808-21kworker/u8:1+events_unbound11:06:200
673958992822,5cyclictest809701-21kworker/u8:3+flush-8:009:56:120
673958992821,6cyclictest994054-21kworker/u8:0+flush-8:012:36:150
673958992819,7cyclictest809701-21kworker/u8:3+flush-8:011:31:140
673964992718,4cyclictest690989-21apt-get07:26:012
673964992717,7cyclictest714664-21ps07:46:152
673964992716,8cyclictest805600-21diskstats09:21:042
673964992716,8cyclictest715959-21/usr/sbin/munin07:51:042
673964992714,10cyclictest884757-21seq10:40:182
673964992711,4cyclictest978139-21ntpq12:11:152
673964992711,12cyclictest909524-21runrttasks11:05:012
673960992724,2cyclictest869639-21turbostat.cron10:24:591
673958992723,3cyclictest754758-21unixbench_multi08:26:200
673958992723,3cyclictest3518702-21kworker/u8:2+flush-8:008:11:160
673958992722,3cyclictest809701-21kworker/u8:3+flush-8:011:41:070
673958992721,5cyclictest685357-21kworker/u8:0+flush-8:008:46:130
67396499267,5cyclictest684912-21ntpq07:16:162
673964992614,9cyclictest875803-21/usr/sbin/munin10:31:092
673964992612,12cyclictest755116-21seq08:29:442
673964992610,12cyclictest899927-21chrt10:56:012
673960992618,6cyclictest889472-21latency_hist10:45:011
673958992623,2cyclictest859994-21/usr/sbin/munin10:16:170
673958992623,2cyclictest744940-21unixbench_singl08:16:210
673958992622,3cyclictest776255-21irqcore08:51:080
673958992622,3cyclictest725546-21kworker/u8:1+flush-8:009:41:180
67396499257,4cyclictest724680-21ntpq07:56:142
673964992519,4cyclictest280-21systemd-journal09:30:002
673964992519,4cyclictest0-21swapper/211:15:012
673964992516,7cyclictest998112-21ntpq12:31:132
673964992515,8cyclictest973483-21/usr/sbin/munin12:06:212
673964992515,8cyclictest779845-21/usr/sbin/munin08:51:212
673964992514,8cyclictest755969-21/usr/sbin/munin08:31:062
673964992514,8cyclictest755969-21/usr/sbin/munin08:31:052
673964992513,10cyclictest775176-21seq08:47:172
673964992512,11cyclictest789909-21taskset09:01:272
673964992512,11cyclictest745056-21chrt08:17:302
673958992521,3cyclictest809701-21kworker/u8:3+flush-8:011:26:130
673958992521,3cyclictest685357-21kworker/u8:0+events_unbound07:46:130
673958992518,5cyclictest869296-21grep10:21:200
673958992518,5cyclictest280-21systemd-journal07:32:270
673958992517,6cyclictest280-21systemd-journal07:45:000
673958992516,7cyclictest755454-21/usr/sbin/munin08:31:120
673958992516,7cyclictest755454-21/usr/sbin/munin08:31:120
67395899251,23cyclictest819729-21sshd09:32:400
673958992511,12cyclictest884115-21grep10:36:180
673964992418,2cyclictest799116-21/usr/sbin/munin09:11:122
673964992417,4cyclictest893516-21ntpq10:46:122
673964992417,4cyclictest893516-21ntpq10:46:122
673964992415,7cyclictest925122-21/usr/sbin/munin11:21:062
673964992415,7cyclictest770118-21unixbench_singl08:41:202
673964992413,8cyclictest869920-21taskset10:25:422
673964992412,9cyclictest825176-21chrt09:40:572
673964992412,9cyclictest700792-21taskset07:35:282
673964992412,10cyclictest953904-21chrt11:48:132
673964992412,10cyclictest710403-21chrt07:44:152
673964992411,10cyclictest839942-21seq09:55:152
673958992420,3cyclictest900218-21grep10:56:050
673958992419,4cyclictest3518702-21kworker/u8:2+flush-8:007:11:140
673958992413,9cyclictest0-21swapper/007:26:050
7194412230,2chrt451irq_work/307:51:153
673964992316,3cyclictest988270-21ntpq12:21:132
673964992312,9cyclictest673963-21sed07:10:012
673964992310,11cyclictest815979-21sed09:31:062
673964992310,10cyclictest939476-21chrt11:35:532
673958992320,2cyclictest0-21swapper/011:01:030
673964992212,8cyclictest795027-21taskset09:08:502
673958992218,3cyclictest685357-21kworker/u8:0+events_unbound09:36:180
673958992218,2cyclictest0-21swapper/009:25:010
673958992218,2cyclictest0-21swapper/009:01:070
673958992217,3cyclictest0-21swapper/009:16:200
673958992216,4cyclictest943819-21unixbench_singl11:36:170
673958992213,7cyclictest998131-21ntpq12:31:140
673958992212,8cyclictest280-21systemd-journal10:45:000
67395899221,19cyclictest401-21dbus-daemon10:35:000
673958992115,5cyclictest673823-21kworker/u8:1+events_unbound07:16:190
6736442212,13sleep00-21swapper/007:08:270
673958992016,3cyclictest884808-21kworker/u8:1+events_unbound11:46:120
673958992011,7cyclictest791062-21sed09:06:080
673958991913,4cyclictest685357-21kworker/u8:0+flush-8:008:01:160
6691372183,8sleep30-21swapper/307:05:083
8409092166,6sleep30-21swapper/309:56:083
9940192142,6sleep30-21swapper/312:30:013
8043942142,8sleep30-21swapper/309:16:193
6951622144,7sleep30-21swapper/307:26:203
9781102132,7sleep30-21swapper/312:11:153
9688372133,5sleep30-21swapper/312:05:003
9245872132,6sleep30-21swapper/311:20:023
9147282132,7sleep30-21swapper/311:11:043
7996332134,5sleep30-21swapper/309:11:213
7629062132,7sleep30-21swapper/308:36:103
7542952132,7sleep30-21swapper/308:26:153
7219432132,7sleep30-21swapper/307:56:093
6794752132,7sleep30-21swapper/307:15:033
9988812122,6sleep30-21swapper/312:33:463
9841912123,5sleep30-21swapper/312:20:023
9833652123,6sleep30-21swapper/312:16:153
9590122122,5sleep30-21swapper/311:55:023
9581592122,6sleep30-21swapper/311:51:163
9493712122,6sleep30-21swapper/311:45:433
9466392122,6sleep30-21swapper/311:41:093
9342642122,5sleep30-21swapper/311:30:023
9336862122,6sleep30-21swapper/311:26:193
9092572122,5sleep30-21swapper/311:05:023
8985982122,6sleep30-21swapper/310:51:173
8900402122,6sleep30-21swapper/310:46:043
8900402122,6sleep30-21swapper/310:46:043
8848462122,6sleep30-21swapper/310:41:023
8798362122,6sleep30-21swapper/310:35:443
8748022122,5sleep30-21swapper/310:30:023
8693722122,7sleep30-21swapper/310:21:403
8347692122,6sleep30-21swapper/309:50:023
8310462122,6sleep30-21swapper/309:46:083
8251012122,5sleep30-21swapper/309:40:023
8100062122,5sleep30-21swapper/309:25:023
8052992122,6sleep30-21swapper/309:20:393
7855922122,6sleep30-21swapper/309:01:023
7557202122,6sleep30-21swapper/308:31:043
7557202122,6sleep30-21swapper/308:31:043
7057682122,6sleep30-21swapper/307:40:403
7054322122,6sleep30-21swapper/307:39:403
6857472122,5sleep30-21swapper/307:20:023
9398812112,5sleep30-21swapper/311:36:043
9236362112,5sleep30-21swapper/311:16:173
9055322110,7sleep30-21swapper/311:01:083
9007682112,5sleep30-21swapper/310:56:073
8702202112,5sleep30-21swapper/310:26:043
8597172112,5sleep30-21swapper/310:15:023
8550382113,5sleep30-21swapper/310:10:443
8500252112,5sleep30-21swapper/310:05:023
8155082112,5sleep30-21swapper/309:31:043
7905282112,5sleep30-21swapper/309:06:033
7806082112,5sleep30-21swapper/308:56:003
7749512112,5sleep30-21swapper/308:46:213
7659712112,5sleep30-21swapper/308:41:043
7455842112,5sleep30-21swapper/308:21:003
7407232112,5sleep30-21swapper/308:16:043
7354802112,5sleep30-21swapper/308:10:023
7348862112,6sleep30-21swapper/308:06:203
7257512112,5sleep30-21swapper/308:00:023
6968092112,5sleep30-21swapper/307:31:093
6764562112,5sleep30-21swapper/307:11:113
10041922111,6sleep30-21swapper/312:40:003
9694862100,6sleep30-21swapper/312:06:053
8240902102,5sleep30-21swapper/309:36:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional