You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-11-05 - 15:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot1s.osadl.org (updated Thu Nov 05, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
195516215256,81sleep20-21swapper/219:05:042
200931215059,78sleep30-21swapper/319:06:513
200872211254,22sleep10-21swapper/119:06:041
20090829952,37sleep00-21swapper/019:06:310
201389992316,2cyclictest171rcu_preempt22:35:010
201389992118,2cyclictest554235-21unix_chkpwd00:00:000
201392991917,1cyclictest0-21swapper/322:24:593
201390991916,2cyclictest587128-21grep00:25:021
201390991916,2cyclictest353697-21systemd-run21:15:011
201390991916,2cyclictest299695-21fschecks_count20:30:411
201390991913,5cyclictest811-21rs:main1
201389991916,2cyclictest444709-21unix_chkpwd22:30:000
201390991815,2cyclictest347582-21latency_hist21:10:011
201389991814,3cyclictest808-21in:imuxsock23:07:270
201389991814,3cyclictest497267-21kthreadcore23:10:420
20138999181,11cyclictest516659-21cat23:25:420
20139099175,11cyclictest426542-21systemd-run22:15:001
20139099174,11cyclictest591-21dbus-daemon20:00:001
201390991714,2cyclictest591-21dbus-daemon23:15:001
201390991714,2cyclictest475177-21systemd-run22:55:001
201390991714,2cyclictest263009-21cpuspeed_turbos20:00:361
201390991714,2cyclictest1162-21cron22:39:551
20138999176,9cyclictest229784-21cut19:30:430
201389991714,2cyclictest481565-21/usr/sbin/munin23:00:300
201389991714,2cyclictest262947-21cpuspeed_turbos20:00:350
201389991713,3cyclictest587-21avahi-daemon20:35:000
201389991713,3cyclictest542527-21aten_repower_en23:50:230
201389991713,3cyclictest468079-21head22:45:420
201389991713,3cyclictest348206-21cstates21:10:360
201389991713,3cyclictest238380-21aten_repower_fr19:40:250
201391991614,1cyclictest0-21swapper/223:25:012
201391991614,1cyclictest0-21swapper/220:35:002
20139099169,6cyclictest530278-21sort23:40:191
20139099167,7cyclictest828-21gdbus21:35:001
20139099165,10cyclictest591-21dbus-daemon23:40:001
201390991613,2cyclictest591-21dbus-daemon19:40:001
20138999168,7cyclictest511464-21sshd-session23:23:270
20138999168,7cyclictest298723-21cron20:30:000
20138999168,6cyclictest604138-21memory00:35:470
20138999167,6cyclictest432790-21cut22:20:020
20138999164,10cyclictest572384-21sshd-session00:13:350
201389991613,2cyclictest460043-21kthreadcore22:40:410
201389991613,2cyclictest0-21swapper/023:40:000
201389991612,3cyclictest557122-21kthreadcore00:00:410
201389991612,3cyclictest451131-21acpi22:35:180
201389991612,3cyclictest220044-21aten_repower_en19:25:240
5239272150,5sleep0524060-21sed23:35:010
3568002150,1sleep1356804-21tr21:15:431
340098150,3rtkit-daemon105451-21gmain22:57:151
201392991513,1cyclictest0-21swapper/321:55:013
201391991513,1cyclictest0-21swapper/222:40:352
201391991513,1cyclictest0-21swapper/220:00:452
201391991513,1cyclictest0-21swapper/200:30:022
20139099157,7cyclictest253-21systemd-journal23:24:551
20139099156,7cyclictest253-21systemd-journal22:20:001
20139099154,10cyclictest591-21dbus-daemon20:40:011
20139099151,5cyclictest341630-21munin-run21:05:021
201390991512,2cyclictest554370-21systemd-run00:00:011
201390991512,2cyclictest335276-21sendmail21:00:001
201390991511,3cyclictest572507-21latency_hist00:15:011
201390991511,3cyclictest433552-21fschecks_count22:20:371
201390991511,3cyclictest414918-21aten_repower_vo22:05:341
201390991511,3cyclictest231237-21timerandwakeup19:30:481
20139099151,10cyclictest493402-21systemd-run23:10:011
20139099150,8cyclictest464124-21cat22:45:381
20138999158,6cyclictest591-21dbus-daemon23:00:000
20138999157,7cyclictest335933-21cpuspeed_turbos21:00:380
20138999156,7cyclictest500554-21if_enp1s023:15:390
20138999156,7cyclictest390667-21ls21:45:380
20138999156,7cyclictest219735-21cat19:25:000
20138999156,7cyclictest1-21systemd22:10:010
20138999155,9cyclictest594309-21irqcore00:30:420
20138999155,9cyclictest531573-21kthreadcore23:40:410
20138999155,9cyclictest360275-21cpuspeed_turbos21:20:360
20138999155,9cyclictest208117-21cpuspeed_turbos19:15:350
20138999155,6cyclictest260851-21kthreadcore19:55:420
20138999154,10cyclictest579030-21cut00:20:230
20138999154,10cyclictest366849-21if_eno121:25:410
20138999154,10cyclictest287275-21cut20:20:360
201389991511,3cyclictest572964-21aten_repower_fr00:15:250
201389991511,3cyclictest566413-21cron00:10:000
201389991511,3cyclictest380837-21kthreadcore21:35:420
201389991511,3cyclictest372280-21aten_repower_po21:30:300
201389991511,3cyclictest326243-21kthreadcore20:50:430
201389991511,3cyclictest318512-21irqrtprio20:45:440
201389991511,3cyclictest244704-21cpuspeed_turbos19:45:370
201389991511,3cyclictest232265-21aten_repower_en19:35:240
201389991511,3cyclictest203677-21kthreadcore19:10:410
201392991412,1cyclictest0-21swapper/323:52:283
201392991412,1cyclictest0-21swapper/321:25:483
201392991412,1cyclictest0-21swapper/321:15:013
201392991412,1cyclictest0-21swapper/319:35:003
20139199144,8cyclictest251059-21chrt19:50:382
201391991412,1cyclictest0-21swapper/221:10:012
20139099147,6cyclictest599111-21unix_chkpwd00:34:591
20139099146,7cyclictest253-21systemd-journal23:55:001
20139099145,7cyclictest448135-21cut22:30:421
20139099145,7cyclictest324601-21sed20:50:421
20139099145,7cyclictest320320-21cut20:45:461
20139099145,6cyclictest518598-21expr23:30:381
20139099143,7cyclictest238897-21tune2fs19:40:361
201390991411,2cyclictest379491-21kthreadcore21:35:421
201390991411,2cyclictest201387-21cyclictest22:00:421
201390991411,2cyclictest0-21swapper/119:55:001
201390991410,3cyclictest564876-21kthreadcore00:05:411
201390991410,3cyclictest556810-21kthreadcore00:00:411
201390991410,3cyclictest481871-21cpuspeed_turbos23:00:381
201390991410,3cyclictest439139-21aten_repower_po22:25:301
201390991410,3cyclictest311420-21aten_repower_fr20:40:271
20138999147,6cyclictest420427-21cron22:10:020
20138999146,7cyclictest587666-21cstates00:25:380
20138999146,7cyclictest353909-21apt-get21:15:190
20138999146,6cyclictest471604-21cut22:50:400
20138999146,6cyclictest437826-21cut22:20:430
20138999145,8cyclictest536782-21cstates23:45:340
20138999145,7cyclictest389971-21sshd-auth21:44:270
20138999145,7cyclictest275234-21cat20:10:370
20138999145,7cyclictest275234-21cat20:10:360
20138999144,9cyclictest270024-21kthreadcore20:05:420
20138999143,3cyclictest151ktimers/022:00:030
20138999143,10cyclictest312890-21kthreadcore20:40:420
201389991411,2cyclictest0-21swapper/020:16:280
201392991311,1cyclictest0-21swapper/323:25:013
201392991311,1cyclictest0-21swapper/321:09:553
201392991311,1cyclictest0-21swapper/320:35:473
201392991311,1cyclictest0-21swapper/320:35:003
201392991311,1cyclictest0-21swapper/300:30:023
201391991311,1cyclictest0-21swapper/223:15:002
201391991311,1cyclictest0-21swapper/220:00:012
201391991311,1cyclictest0-21swapper/219:35:372
20139099139,3cyclictest203334-21kthreadcore19:10:411
20139099137,4cyclictest220555-21df19:25:381
20139099136,6cyclictest387366-21kthreadcore21:40:411
20139099135,7cyclictest604497-21systemctl00:35:501
20139099135,7cyclictest360693-21sh21:20:381
20139099135,7cyclictest294048-21sed20:25:411
20139099135,6cyclictest589624-21kthreadcore00:25:431
20139099135,6cyclictest459132-21cut22:40:401
20139099135,6cyclictest292676-21cat20:25:001
20139099135,6cyclictest269719-21irqcore20:05:411
20139099134,7cyclictest404502-21cat21:55:411
20139099134,7cyclictest248785-21cut19:45:431
201390991310,2cyclictest397800-21kthreadcore21:50:391
201390991310,2cyclictest393180-21kthreadcore21:45:431
201390991310,2cyclictest215116-21irqrtprio19:20:401
201390991310,2cyclictest1162-21cron23:25:031
20139099130,11cyclictest277135-21cut20:10:411
20139099130,11cyclictest277135-21cut20:10:411
20138999139,3cyclictest329569-21aten_repower_cu20:55:190
20138999136,6cyclictest341827-21aten_repower_fr21:05:290
20138999135,7cyclictest305474-21sort20:35:360
20138999135,6cyclictest396563-21aten_repower_fr21:50:280
20138999135,6cyclictest250578-21aten_repower_po19:50:300
201389991310,2cyclictest408707-21aten_repower_en22:00:240
201392991210,1cyclictest0-21swapper/323:40:333
201392991210,1cyclictest0-21swapper/322:40:353
201392991210,1cyclictest0-21swapper/320:15:373
201392991210,1cyclictest0-21swapper/320:10:373
201392991210,1cyclictest0-21swapper/320:10:373
201392991210,1cyclictest0-21swapper/320:00:453
201392991210,1cyclictest0-21swapper/319:20:333
20139299120,9cyclictest414117-21chrt22:01:413
20139299120,9cyclictest298467-21chrt20:26:423
20139299120,7cyclictest578615-21sleep00:20:003
20139299120,10cyclictest65450irq/121-eno123:14:203
20139299120,10cyclictest65450irq/121-eno123:04:473
20139299120,10cyclictest65450irq/121-eno119:45:453
20139299120,10cyclictest65450irq/121-eno119:36:263
20139299120,10cyclictest65450irq/121-eno100:35:373
20139299120,10cyclictest402194-21turbostat21:59:553
20139199123,7cyclictest562761-21chrt00:05:412
20139199121,9cyclictest487142-21chrt23:03:402
20139199121,8cyclictest604963-21chrt00:37:062
20139199121,8cyclictest542592-21taskset23:50:292
20139199121,8cyclictest463491-21chrt22:45:302
20139199121,8cyclictest451263-21chrt22:35:272
20139199121,8cyclictest401927-21chrt21:51:542
20139199121,8cyclictest293145-21chrt20:25:292
20139199121,8cyclictest286921-21chrt20:20:052
20139199121,8cyclictest286271-21chrt20:16:112
201391991210,1cyclictest0-21swapper/223:30:432
201391991210,1cyclictest0-21swapper/223:05:432
201391991210,1cyclictest0-21swapper/222:05:192
201391991210,1cyclictest0-21swapper/221:45:012
201391991210,1cyclictest0-21swapper/221:30:422
201391991210,1cyclictest0-21swapper/219:20:422
201391991210,1cyclictest0-21swapper/200:20:022
20139199120,9cyclictest408809-21chrt22:00:322
20139199120,10cyclictest238375-21chrt19:40:242
20139099128,3cyclictest341ktimers/119:15:281
20139099128,3cyclictest280921-21aten_repower_en20:15:241
20139099125,6cyclictest573432-21df00:15:361
20139099123,7cyclictest368636-21cut21:25:431
20139299119,1cyclictest0-21swapper/323:36:563
20139299119,1cyclictest0-21swapper/323:31:483
20139299119,1cyclictest0-21swapper/323:26:413
20139299119,1cyclictest0-21swapper/322:33:263
20139299119,1cyclictest0-21swapper/321:46:203
20139299119,1cyclictest0-21swapper/321:00:313
20139299119,1cyclictest0-21swapper/320:45:553
20139299119,1cyclictest0-21swapper/320:40:273
20139299119,1cyclictest0-21swapper/300:05:363
20139299117,1cyclictest0-21swapper/319:10:323
20139299111,8cyclictest65450irq/121-eno120:21:233
20139299111,8cyclictest469647-21chrt22:50:353
20139299110,9cyclictest65450irq/121-eno123:55:193
20139299110,9cyclictest65450irq/121-eno122:25:203
20139299110,9cyclictest65450irq/121-eno122:05:473
20139299110,9cyclictest65450irq/121-eno121:37:383
20139299110,9cyclictest65450irq/121-eno121:15:103
20139299110,9cyclictest65450irq/121-eno119:29:213
20139299110,9cyclictest65450irq/121-eno100:20:123
20139299110,9cyclictest499433-21turbostat23:19:553
20139299110,9cyclictest426442-21chrt22:14:153
20139299110,9cyclictest383923-21turbostat21:44:553
20139299110,9cyclictest262010-21chrt19:57:173
20139299110,4cyclictest4932692sleep323:08:543
20139299110,10cyclictest237926-21sleep19:44:553
20139199119,2cyclictest0-21swapper/200:30:112
20139199119,1cyclictest0-21swapper/223:46:092
20139199119,1cyclictest0-21swapper/223:43:042
20139199119,1cyclictest0-21swapper/223:36:562
20139199119,1cyclictest0-21swapper/222:51:522
20139199119,1cyclictest0-21swapper/222:25:152
20139199119,1cyclictest0-21swapper/222:20:162
20139199119,1cyclictest0-21swapper/220:45:552
20139199119,1cyclictest0-21swapper/200:03:332
20139199112,7cyclictest360062-21chrt21:20:242
20139199111,8cyclictest586699-21chrt00:22:442
20139199111,8cyclictest517659-21chrt23:29:222
20139199111,8cyclictest407950-21chrt21:56:112
20139199111,8cyclictest359311-21chrt21:16:312
20139199111,8cyclictest334941-21chrt20:56:152
20139199111,8cyclictest324725-21chrt20:50:422
20139199111,8cyclictest316799-21chrt20:42:252
20139199111,8cyclictest310886-21chrt20:39:442
20139199111,8cyclictest274281-21chrt20:07:422
20139199111,8cyclictest213231-21chrt19:16:322
20139199111,8cyclictest207209-21chrt19:11:592
20139199110,9cyclictest554014-21chrt23:57:192
20139199110,9cyclictest481126-21chrt22:59:072
20139199110,8cyclictest426890-21chrt22:15:192
20139199110,8cyclictest425618-21chrt22:10:462
20139199110,8cyclictest390359-21chrt21:45:132
20139099114,5cyclictest536368-21acpi23:45:161
20139299108,1cyclictest0-21swapper/322:35:293
20139299108,1cyclictest0-21swapper/319:15:393
20139299108,1cyclictest0-21swapper/300:00:023
20139299100,9cyclictest0-21swapper/300:10:303
20139299100,8cyclictest65450irq/121-eno120:05:473
20139299100,8cyclictest593369-21taskset00:30:153
20139299100,8cyclictest536351-21chrt23:45:053
20139299100,8cyclictest480933-21chrt22:56:363
20139299100,8cyclictest468836-21chrt22:47:263
20139299100,8cyclictest426845-21chrt22:15:123
20139299100,8cyclictest372096-21chrt21:30:073
20139299100,8cyclictest360174-21chrt21:20:333
20139299100,8cyclictest329512-21chrt20:55:043
20139299100,8cyclictest323526-21chrt20:50:233
20139299100,8cyclictest255844-21chrt19:51:083
20139199101,7cyclictest566753-21chrt00:10:132
20139199101,7cyclictest505218-21chrt23:16:152
20139199101,7cyclictest447846-21chrt22:30:422
20139199101,7cyclictest378177-21chrt21:35:072
20139199101,7cyclictest366094-21chrt21:25:212
20139199101,7cyclictest352348-21chrt21:10:422
20139199101,7cyclictest335582-21chrt21:00:052
20139199101,7cyclictest274791-21chrt20:10:062
20139199101,7cyclictest274791-21chrt20:10:062
20139199100,8cyclictest244364-21chrt19:45:172
20139199100,8cyclictest226022-21chrt19:30:062
20139199100,8cyclictest219948-21chrt19:25:092
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional