You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 05:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System (updated Tue Dec 02, 2025 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1623991460,8rtkit-daemon1622-21rtkit-daemon00:00:352
357593821140,5sleep00-21swapper/019:05:190
35767292920,4sleep10-21swapper/119:06:241
357692528145,14sleep20-21swapper/219:08:472
35967932800,7sleep31753-21gnome-shell20:05:023
357690528060,14sleep30-21swapper/319:08:323
36168142760,8sleep33616589-40apt-check21:00:153
162399750,6rtkit-daemon0-21swapper/000:27:440
36927422700,5sleep30-21swapper/300:35:213
357715699680,64cyclictest1622-21rtkit-daemon00:00:363
162399590,8rtkit-daemon1622-21rtkit-daemon00:18:323
357715099575,27cyclictest854-21avahi-daemon22:55:461
36508962560,8sleep22197014-21PK-Backend22:35:262
162399560,9rtkit-daemon1622-21rtkit-daemon20:22:381
162399560,9rtkit-daemon1622-21rtkit-daemon20:21:150
3577152995516,21cyclictest3589766-21sh19:45:012
357715099559,19cyclictest3669949-21expr23:30:171
357715099559,19cyclictest3669949-21expr23:30:171
357715099557,15cyclictest3689003-21cstates00:25:141
3577150995511,14cyclictest3615931-21runrttasks20:58:141
3577156995430,20cyclictest1753-21gnome-shell19:23:123
357715699530,49cyclictest1622-21rtkit-daemon00:31:473
357715099539,19cyclictest1753-21gnome-shell22:20:211
3577150995313,15cyclictest1753-21gnome-shell00:21:331
3577150995310,18cyclictest1753-21gnome-shell23:45:251
162399530,5rtkit-daemon0-21swapper/222:01:172
357715099528,20cyclictest3625848-21cstates21:25:181
357715099528,20cyclictest1617-10pipewire-media-20:35:151
3577150995215,32cyclictest3651177-21cat22:35:321
162399520,5rtkit-daemon2197014-21PK-Backend22:33:042
3577156995117,19cyclictest42-21ksoftirqd/300:24:593
357715099518,21cyclictest3663650-21sed23:10:311
357715099517,21cyclictest3613136-21expr20:50:151
3577150995114,12cyclictest1753-21gnome-shell22:34:461
357715699501,26cyclictest994-21lldpd19:55:013
357715099509,17cyclictest1753-21gnome-shell21:10:281
357715099508,19cyclictest3678954-21missed_timers23:55:261
357715099508,15cyclictest3665065-21memory23:15:231
3577150995012,15cyclictest3605280-21seq20:29:011
3577150995012,10cyclictest869-21irqbalance22:07:341
357715099499,16cyclictest3623898-21apt21:20:121
357715099499,16cyclictest3606320-21hddtemp_smartct20:30:211
357715099498,15cyclictest3595622-21chrt20:00:201
357715099497,19cyclictest3676797-21expr23:50:141
357715099496,17cyclictest3635693-21users21:50:321
357715099496,15cyclictest3668372-21basename23:25:211
3577150994915,29cyclictest1825-21JS14:31:441
3577150994912,22cyclictest1753-21gnome-shell19:39:251
3577150994911,16cyclictest3681820-21taskset00:05:051
3577150994910,15cyclictest3674388-21python323:42:181
162399490,35rtkit-daemon2197014-21PK-Backend19:56:192
357715099489,16cyclictest904-21systemd-logind19:15:001
357715099489,16cyclictest3579140-21missed_timers19:15:021
357715099488,16cyclictest3638438-21df22:00:141
357715099488,16cyclictest1753-21gnome-shell22:25:281
357715099487,16cyclictest3680427-21cstates00:00:141
3577150994812,10cyclictest3583487-21/usr/sbin/munin19:25:211
3577150994810,15cyclictest2197014-21PK-Backend20:15:291
3577150994810,14cyclictest3633752-21python321:45:321
36769312470,6sleep0161rcuc/023:50:140
35944432470,6sleep3411rcuc/319:55:313
35867142470,5sleep22197014-21PK-Backend19:35:142
357715299477,16cyclictest1753-21gnome-shell22:50:142
3577152994724,20cyclictest3634359-21awk21:50:012
357715099477,18cyclictest3588692-21entropy19:40:191
357715099477,15cyclictest3655453-21apt22:50:111
3577150994712,20cyclictest1753-21gnome-shell23:38:061
3577146994726,16cyclictest3242253-21nautilus23:05:000
36186832460,8sleep31753-21gnome-shell21:05:163
36186832460,8sleep31753-21gnome-shell21:05:153
3577156994636,6cyclictest42-21ksoftirqd/319:34:513
3577156994618,12cyclictest141rcu_preempt22:30:493
357715099468,14cyclictest3684343-21ntp_states00:10:291
357715099466,16cyclictest1-21systemd20:15:011
3577150994612,29cyclictest1738-21gdbus23:21:561
3577150994612,14cyclictest3659928-21/usr/sbin/munin23:00:331
162399460,31rtkit-daemon1753-21gnome-shell23:30:583
162399460,31rtkit-daemon1753-21gnome-shell23:30:583
357715699459,20cyclictest42-21ksoftirqd/322:45:123
357715699459,19cyclictest42-21ksoftirqd/321:52:513
357715699454,14cyclictest0-21swapper/319:50:003
357715699453,17cyclictest42-21ksoftirqd/320:34:413
3577156994527,13cyclictest438-20systemd-journal22:10:013
3577156994523,9cyclictest42-21ksoftirqd/322:50:463
3577156994512,15cyclictest0-21swapper/322:10:313
357715699451,18cyclictest1753-21gnome-shell20:53:193
357715299458,17cyclictest141rcu_preempt20:35:002
3577152994511,12cyclictest141rcu_preempt20:50:392
357715099458,14cyclictest3617687-21sort21:00:341
357715099457,15cyclictest908-21gdbus22:45:111
357715099455,15cyclictest3693660-21sshd00:38:541
3577150994510,14cyclictest3592357-21memory19:50:231
162399450,30rtkit-daemon1753-21gnome-shell23:10:172
357715699446,20cyclictest42-21ksoftirqd/319:25:293
357715699443,19cyclictest42-21ksoftirqd/323:20:563
3577156994412,18cyclictest42-21ksoftirqd/321:21:363
3577156994411,12cyclictest42-21ksoftirqd/321:45:153
357715099448,15cyclictest1753-21gnome-shell20:10:021
357715099448,15cyclictest1753-21gnome-shell20:10:021
357715099447,15cyclictest3686808-21basename00:20:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional