You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-01 - 04:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackcslot7s.osadl.org (updated Tue Jul 01, 2025 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
377014922580,8sleep20-21swapper/219:06:372
377418521110,5sleep00-21swapper/019:16:570
38556552990,8sleep22197014-21PK-Backend23:10:162
162399950,77rtkit-daemon0-21swapper/019:05:090
162399920,5rtkit-daemon0-21swapper/022:32:100
162399830,6rtkit-daemon0-21swapper/021:10:300
162399790,6rtkit-daemon0-21swapper/020:37:050
162399790,5rtkit-daemon0-21swapper/022:02:320
38701432750,9sleep30-21swapper/323:50:293
162399740,10rtkit-daemon970-21ntpd00:24:101
377032227341,26sleep10-21swapper/119:08:501
162399730,11rtkit-daemon970-21ntpd23:49:061
38810672720,5sleep10-21swapper/100:25:211
162399720,9rtkit-daemon881143-21gmain23:31:171
162399720,6rtkit-daemon970-21ntpd00:13:451
162399710,7rtkit-daemon970-21ntpd23:11:441
162399710,4rtkit-daemon0-21swapper/119:37:091
377026626954,9sleep30-21swapper/319:08:093
162399690,8rtkit-daemon970-21ntpd19:45:401
162399620,9rtkit-daemon1622-21rtkit-daemon23:50:271
377055599610,56cyclictest1622-21rtkit-daemon00:09:381
3770550996119,14cyclictest3882751-21df00:30:170
38621252600,14chrt1753-21gnome-shell23:30:013
3770550996029,26cyclictest3794237-21diskstats20:15:220
3770550996022,9cyclictest3810962-21mktemp21:05:020
3770550996022,9cyclictest3810962-21mktemp21:05:010
162399600,9rtkit-daemon1622-21rtkit-daemon23:55:270
3770550995819,12cyclictest3791272-21grep20:05:290
3770550995816,16cyclictest1753-21gnome-shell19:13:000
162399580,8rtkit-daemon1622-21rtkit-daemon20:12:580
377055099579,18cyclictest1753-21gnome-shell21:27:360
3770550995713,14cyclictest875-21polkitd19:50:370
3770550995710,16cyclictest1753-21gnome-shell20:34:540
38258712560,25sleep2331rcuc/221:45:272
3770550995612,14cyclictest3242255-21gdbus00:25:020
3770550995612,13cyclictest468-21systemd-udevd22:44:570
377055099559,16cyclictest1753-21gnome-shell21:47:070
377055099558,16cyclictest1753-21gnome-shell20:50:410
377055099558,16cyclictest1753-21gnome-shell20:21:060
377055099557,17cyclictest1753-21gnome-shell21:58:200
377055099553,24cyclictest3857963-21proc_pri23:15:270
3770550995519,7cyclictest3850218-21/usr/sbin/munin22:55:220
3770550995519,7cyclictest3850218-21/usr/sbin/munin22:55:220
3770550995514,11cyclictest3804397-21grep20:45:140
3770550995514,11cyclictest3804397-21grep20:45:140
3770550995510,16cyclictest1753-21gnome-shell21:10:000
162399550,8rtkit-daemon1622-21rtkit-daemon23:46:240
377055099549,17cyclictest1753-21gnome-shell23:10:110
377055099548,17cyclictest1753-21gnome-shell20:27:060
377055099548,16cyclictest1753-21gnome-shell00:13:460
377055099546,18cyclictest1753-21gnome-shell21:15:590
377055099541,8cyclictest1753-21gnome-shell21:39:060
3770550995418,7cyclictest3870050-21sh23:50:280
3770550995416,11cyclictest438-20systemd-journal21:54:560
377055099541,23cyclictest1753-21gnome-shell22:38:060
377055099541,22cyclictest3817359-21uname21:20:280
3770550995410,18cyclictest1753-21gnome-shell19:24:170
3770550995410,18cyclictest1753-21gnome-shell19:24:160
377055099539,16cyclictest1753-21gnome-shell23:04:310
377055099539,16cyclictest1753-21gnome-shell19:35:470
377055099539,16cyclictest1753-21gnome-shell19:28:130
377055099536,17cyclictest1753-21gnome-shell23:08:070
377055099531,21cyclictest3861203-21cat23:25:230
3770550995310,17cyclictest1753-21gnome-shell22:19:100
37948682520,6sleep10-21swapper/120:15:341
3770555995210,14cyclictest26-21ksoftirqd/120:45:451
3770555995210,14cyclictest26-21ksoftirqd/120:45:441
377055099529,17cyclictest1753-21gnome-shell22:11:370
377055099529,16cyclictest1753-21gnome-shell23:23:320
377055099529,16cyclictest1753-21gnome-shell19:43:470
377055099529,16cyclictest1753-21gnome-shell00:02:050
377055099528,18cyclictest1753-21gnome-shell22:06:060
377055099528,17cyclictest1753-21gnome-shell00:06:060
3770550995216,7cyclictest3840333-21grep22:25:250
3770550995216,7cyclictest1753-21gnome-shell23:41:050
377055099519,16cyclictest1753-21gnome-shell23:31:060
377055099519,16cyclictest1753-21gnome-shell21:40:310
377055099519,16cyclictest1753-21gnome-shell00:19:350
3770550995117,7cyclictest1069-21runrttasks00:25:370
3770550995115,7cyclictest1753-21gnome-shell00:35:320
377055099511,25cyclictest1753-21gnome-shell19:30:350
3770550995112,11cyclictest3864898-21proc_pri23:35:300
3770550995110,11cyclictest3788709-21cpuspeed_turbos20:00:130
377055099508,16cyclictest1753-21gnome-shell20:56:390
377055099508,16cyclictest1753-21gnome-shell19:47:460
3770550995019,7cyclictest1069-21runrttasks22:50:290
377055099501,23cyclictest1753-21gnome-shell19:59:260
3770556994927,18cyclictest3797060-21cut20:25:012
377055599499,24cyclictest3855023-21seq23:08:241
377055599497,8cyclictest26-21ksoftirqd/119:25:151
377055599484,12cyclictest3242253-21nautilus21:50:011
3770555994814,20cyclictest3791157-21processes20:05:281
38574482470,6sleep22197014-21PK-Backend23:15:162
377055599475,21cyclictest904-21systemd-logind22:44:571
3770555994712,13cyclictest26-21ksoftirqd/120:05:001
377055099472,20cyclictest1753-21gnome-shell20:40:340
3770559994624,19cyclictest0-21swapper/320:36:353
377055699465,19cyclictest1753-21gnome-shell00:15:282
377055699463,21cyclictest3866539-21netstat23:40:242
3770556994618,24cyclictest3772204-21cron19:15:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional