You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-02-06 - 14:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot4s.osadl.org (updated Thu Feb 06, 2025 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
753361994438,4cyclictest769055-21kworker/u8:1+flush-259:019:50:203
753354994438,4cyclictest1956849-21systemd-journal20:01:541
753350994338,4cyclictest940465-21kworker/u8:3+flush-259:022:40:010
753361993528,5cyclictest897120-21latency_hist21:35:003
753361993528,5cyclictest838037-21latency_hist20:35:013
753356993530,4cyclictest769587-21getprofile19:26:032
753354993529,4cyclictest1956849-21systemd-journal20:46:491
753350993533,1cyclictest769568-21lspci19:26:030
753350993327,4cyclictest924168-21kworker/u8:0+flush-259:022:15:010
753361993228,3cyclictest848355-21kworker/u8:3+events_unbound20:50:173
753356993228,3cyclictest1015697-21cat00:00:002
753350993228,3cyclictest907037-21kworker/u8:3+events_unbound21:54:560
753350993226,4cyclictest1956849-21systemd-journal00:13:030
753350993226,4cyclictest1956849-21systemd-journal00:13:030
753361993126,3cyclictest939613-21kworker/u8:0+events_unbound22:35:153
753356993127,3cyclictest763823-21kworker/u8:4+flush-259:019:50:002
753356993125,4cyclictest965740-21ntpq22:55:192
753361993025,4cyclictest1956849-21systemd-journal20:25:003
753354993024,4cyclictest885893-21apt-get21:20:111
753350993027,2cyclictest885858-21kworker/u8:2+flush-259:022:15:150
753350993026,3cyclictest978226-21kworker/u8:0+events_unbound00:05:010
753361992926,2cyclictest972401-21kworker/u8:3+flush-259:023:10:003
753354992925,3cyclictest929548-21/usr/sbin/munin22:15:251
753354992924,4cyclictest807396-21apt-get20:05:121
753350992923,4cyclictest1014651-21ntpq23:55:240
753354992823,3cyclictest1956849-21systemd-journal22:09:551
753354992822,4cyclictest1016177-21/usr/sbin/munin00:00:141
753350992824,3cyclictest994447-21kworker/u8:1+events_unbound23:44:050
753350992824,3cyclictest966593-21kworker/u8:2+events_unbound23:10:560
753350992823,3cyclictest769055-21kworker/u8:1+events_unbound19:40:500
753350992823,3cyclictest769055-21kworker/u8:1+events_unbound19:40:500
753350992822,4cyclictest854371-21diskstats20:50:130
753354992724,2cyclictest763823-21kworker/u8:4+events_unbound19:20:191
753354992719,6cyclictest891911-21latency_hist21:30:001
753350992723,3cyclictest989030-21kworker/u8:4+events_unbound23:37:240
753350992723,3cyclictest978226-21kworker/u8:0+events_unbound00:23:050
753350992722,4cyclictest763823-21kworker/u8:4+flush-259:019:36:500
753361992622,3cyclictest885858-21kworker/u8:2+flush-259:022:10:003
753361992621,3cyclictest978226-21kworker/u8:0+flush-259:023:20:003
753356992620,4cyclictest763857-21apt-get19:20:132
753356992619,5cyclictest902277-21latency_hist21:40:002
75335499264,10cyclictest799743-21cut19:55:191
753350992622,3cyclictest806836-21kworker/u8:0+events_unbound20:32:510
753350992621,4cyclictest978226-21kworker/u8:0+events_unbound00:37:040
753350992621,2cyclictest978226-21kworker/u8:0+events_unbound00:35:010
753361992520,3cyclictest854177-21kworker/u8:4+events_unbound21:00:023
753361992518,5cyclictest811384-21ntpq20:05:203
753356992519,5cyclictest854177-21kworker/u8:4+events_unbound20:50:152
753350992522,2cyclictest812527-21kworker/u8:3+flush-259:020:15:210
753350992521,3cyclictest994447-21kworker/u8:1+events_unbound00:16:030
753350992521,3cyclictest753331-21kworker/u8:0+events_unbound19:21:510
753350992519,4cyclictest806836-21kworker/u8:0+flush-259:020:02:040
753350992518,5cyclictest812312-21kworker/u8:2+flush-259:020:35:170
753361992420,3cyclictest769055-21kworker/u8:1+flush-259:019:26:333
753361992418,4cyclictest768741-21latency_hist19:25:003
753356992420,3cyclictest885858-21kworker/u8:2+flush-259:022:25:002
753350992421,2cyclictest864696-21kworker/u8:1+events_unbound21:25:000
753350992421,2cyclictest848355-21kworker/u8:3+flush-259:020:55:200
753350992420,3cyclictest891933-21kworker/u8:0+events_unbound21:30:110
753350992420,3cyclictest864696-21kworker/u8:1+events_unbound21:35:250
753350992419,3cyclictest854177-21kworker/u8:4+events_unbound21:15:500
753361992317,4cyclictest928384-21ntpq22:10:153
753356992317,4cyclictest1956849-21systemd-journal19:56:332
75335499234,9cyclictest786346-21sshd19:44:491
75335499234,9cyclictest786346-21sshd19:44:491
753354992317,4cyclictest832075-21ntpq20:25:221
753350992320,2cyclictest769055-21kworker/u8:1+flush-259:019:50:260
75335099230,21cyclictest1-21systemd19:33:500
753361992217,4cyclictest978226-21kworker/u8:0+flush-259:000:15:003
753361992217,4cyclictest978226-21kworker/u8:0+flush-259:000:14:593
753361992217,3cyclictest812312-21kworker/u8:2+events_unbound20:45:133
753354992217,3cyclictest983411-21/usr/sbin/munin23:20:121
753354992216,4cyclictest859718-21cat20:55:011
753350992218,3cyclictest913205-21kworker/u8:1+events_unbound23:07:560
753361992118,2cyclictest817490-21cron20:15:003
753361992117,3cyclictest939613-21kworker/u8:0+events_unbound23:00:253
753361992116,4cyclictest880579-21base6421:15:013
753356992118,2cyclictest848335-21idleruntime-cro20:45:012
753356992117,3cyclictest978226-21kworker/u8:0+flush-259:023:35:002
753354992117,3cyclictest961713-21apt-get22:55:081
753354992115,4cyclictest1956849-21systemd-journal19:50:141
753350992118,2cyclictest848355-21kworker/u8:3+flush-259:021:00:250
753350992117,3cyclictest822853-21kworker/u8:1+events_unbound20:40:180
753361992016,3cyclictest989031-21kworker/u8:5+flush-259:000:10:003
753361992016,3cyclictest763823-21kworker/u8:4+flush-259:019:35:243
753361992014,4cyclictest1956849-21systemd-journal00:30:033
753356992016,3cyclictest939613-21kworker/u8:0+flush-259:023:05:002
753356992015,3cyclictest843219-21sh20:40:002
753356992014,4cyclictest890795-21latency_hist21:25:012
753356992014,4cyclictest1956849-21systemd-journal00:21:032
753356992014,4cyclictest1043298-21/usr/sbin/munin00:35:142
75335499200,10cyclictest1015537-21apt-config23:59:591
753350992016,3cyclictest978226-21kworker/u8:0+events_unbound23:22:210
753350992016,3cyclictest972401-21kworker/u8:3+flush-259:023:20:010
753350992016,3cyclictest907037-21kworker/u8:3+events_unbound21:42:510
753350992016,3cyclictest848355-21kworker/u8:3+events_unbound21:10:490
753350992016,3cyclictest806836-21kworker/u8:0+events_unbound20:06:530
753350992013,5cyclictest874052-21ntpq21:05:220
753361991915,3cyclictest988384-21kworker/u8:1+flush-259:023:30:003
753361991915,3cyclictest1032086-21kworker/u8:2+events_unbound00:20:233
753361991915,2cyclictest0-21swapper/323:55:003
753361991914,4cyclictest763823-21kworker/u8:4+flush-259:019:45:183
753356991915,3cyclictest812312-21kworker/u8:2+events_unbound20:45:172
753356991912,5cyclictest896231-21ntpq21:30:172
753354991916,2cyclictest859113-21sh20:55:011
753354991915,2cyclictest0-21swapper/120:25:001
753354991913,4cyclictest978254-21apt-get23:15:131
753350991916,2cyclictest885858-21kworker/u8:2+flush-259:021:55:160
753350991915,3cyclictest913205-21kworker/u8:1+events_unbound22:30:090
753350991915,3cyclictest763823-21kworker/u8:4+events_unbound19:47:500
753361991815,2cyclictest0-21swapper/300:39:593
753361991814,3cyclictest885858-21kworker/u8:2+flush-259:021:55:163
753361991813,4cyclictest812312-21kworker/u8:2+events_unbound20:45:023
753356991814,3cyclictest939613-21kworker/u8:0+flush-259:022:50:002
753356991813,3cyclictest1956849-21systemd-journal00:28:352
753354991814,3cyclictest880464-21gpgv21:15:011
753354991813,3cyclictest1043324-21apt-get00:35:111
75335499180,9cyclictest770051-21sshd19:26:361
75335499180,16cyclictest813584-21ps20:10:221
753350991814,2cyclictest913205-21kworker/u8:1+flush-259:022:40:200
753350991814,2cyclictest812312-21kworker/u8:2+events_unbound20:45:190
753361991714,2cyclictest913205-21kworker/u8:1+flush-259:022:20:213
753361991713,3cyclictest907037-21kworker/u8:3+flush-259:021:45:003
753356991714,2cyclictest874967-21systemd-run21:10:002
753356991712,3cyclictest885858-21kworker/u8:2+events_unbound21:55:182
753356991711,5cyclictest978012-21gpgv23:15:012
75335699171,14cyclictest1-21systemd20:59:492
75335499175,10cyclictest1032961-21cut00:20:171
753354991713,3cyclictest509-21rs:main1
75335499170,15cyclictest977562-21latency_hist23:15:011
75335499170,14cyclictest972376-21latency_hist23:10:011
75335499170,14cyclictest902277-21latency_hist21:40:001
75335499170,14cyclictest753526-21cat19:10:001
753350991713,3cyclictest989031-21kworker/u8:5+events_unbound23:54:040
753350991713,3cyclictest864696-21kworker/u8:1+events_unbound21:26:490
753350991713,3cyclictest822853-21kworker/u8:1+events_unbound20:20:180
753350991713,3cyclictest770087-21kworker/u8:2+events_unbound19:58:510
753350991713,3cyclictest758657-21kworker/u8:2+events_unbound19:16:510
753350991713,3cyclictest743123-21kworker/u8:1+flush-259:019:10:150
753350991712,4cyclictest1956849-21systemd-journal23:46:370
753356991613,2cyclictest1005171-21idleruntime-cro23:50:002
753356991613,2cyclictest0-21swapper/220:20:002
75335499169,6cyclictest0-21swapper/121:15:001
75335499164,10cyclictest948916-21cut22:35:161
75335499163,11cyclictest897117-21sh21:35:001
753354991612,2cyclictest0-21swapper/122:30:011
753354991611,3cyclictest758693-21apt-get19:15:131
75335499160,8cyclictest929311-21latency_hist22:15:011
753350991613,2cyclictest60650irq/133-enp0s29f1:rx-000:05:560
753350991612,3cyclictest885858-21kworker/u8:2+events_unbound22:01:550
753350991612,3cyclictest885858-21kworker/u8:2+events_unbound21:46:500
753361991513,1cyclictest0-21swapper/321:25:003
753361991512,2cyclictest978226-21kworker/u8:0+events_unbound00:00:233
753361991512,2cyclictest913205-21kworker/u8:1+events_unbound22:50:103
753361991511,3cyclictest972401-21kworker/u8:3+events_unbound23:30:173
753361991511,3cyclictest769055-21kworker/u8:1+flush-259:019:35:003
75335699159,4cyclictest758433-21latency_hist19:15:002
75335699158,5cyclictest509-21rs:main2
753356991510,4cyclictest972401-21kworker/u8:3+flush-259:023:19:282
75335499158,5cyclictest1026910-21latency_hist00:15:011
75335499158,5cyclictest1026910-21latency_hist00:15:011
75335499154,9cyclictest833183-21grep20:30:171
75335499151,12cyclictest909296-21sed21:50:121
75335499151,11cyclictest994481-21apt-get23:35:121
75335499150,14cyclictest938818-21ps22:20:231
75335499150,14cyclictest903161-21sed21:40:171
75335499150,14cyclictest0-21swapper/121:00:141
75335499150,13cyclictest952511-21grep22:40:211
75335499150,13cyclictest791012-21grep19:45:251
75335499150,13cyclictest781214-21basename19:40:001
75335499150,13cyclictest1021826-21latency_hist00:10:001
75335499150,13cyclictest1009585-21proc_pri23:50:181
75335499150,12cyclictest940650-21df_inode22:30:091
75335499150,12cyclictest918507-21latency_hist22:00:011
75335099159,4cyclictest1956849-21systemd-journal20:11:520
753350991513,1cyclictest60650irq/133-enp0s29f1:rx-023:01:400
753350991512,2cyclictest913205-21kworker/u8:1+events_unbound22:50:090
753350991511,3cyclictest806836-21kworker/u8:0+events_unbound20:25:130
753361991411,2cyclictest944385-21needreboot22:30:143
753361991411,2cyclictest908729-21irqcore21:50:123
753361991411,2cyclictest812312-21kworker/u8:2+events_unbound20:25:233
753361991410,3cyclictest989030-21kworker/u8:4+events_unbound23:35:223
753361991410,3cyclictest885858-21kworker/u8:2+flush-259:022:15:183
75335699149,3cyclictest929302-21awk22:15:012
753356991411,2cyclictest954734-21ntp_kernel_err22:40:252
753356991410,3cyclictest989031-21kworker/u8:5+flush-259:000:08:452
753356991410,3cyclictest769055-21kworker/u8:1+flush-259:020:00:252
75335499146,6cyclictest0-21swapper/120:45:001
75335499144,7cyclictest835-21runrttasks23:48:041
75335499141,11cyclictest989393-21grep23:30:091
75335499141,11cyclictest1027896-21cut00:15:211
753354991410,3cyclictest770992-21gpgv19:30:011
75335499140,9cyclictest956291-21latency_hist22:50:001
75335499140,12cyclictest919407-21cut22:00:181
75335499140,12cyclictest908057-21cron21:50:011
75335499140,12cyclictest870603-21cut21:05:181
75335499140,12cyclictest840945-21grep20:35:181
75335499140,12cyclictest821849-21ps20:15:231
75335499140,12cyclictest1041064-21grep00:30:131
75335499140,12cyclictest1037978-21latency_hist00:30:011
75335499140,12cyclictest1004538-21latency_hist23:45:001
75335499140,11cyclictest758584-21latency_hist19:15:001
753350991412,1cyclictest60650irq/133-enp0s29f1:rx-022:20:230
753350991411,2cyclictest972401-21kworker/u8:3+events_unbound23:29:550
753350991411,2cyclictest966566-21cron23:00:000
753350991411,2cyclictest60650irq/133-enp0s29f1:rx-000:26:420
753350991410,3cyclictest978226-21kworker/u8:0+events_unbound23:32:570
753350991410,3cyclictest885858-21kworker/u8:2+events_unbound22:09:570
75336199138,4cyclictest939613-21kworker/u8:0+events_unbound22:55:173
75335699139,3cyclictest854177-21kworker/u8:4+flush-259:021:03:542
75335699137,3cyclictest923503-21awk22:05:012
75335699135,5cyclictest837174-21ntpq20:30:262
753356991311,1cyclictest891916-21idleruntime-cro21:29:592
753356991311,1cyclictest0-21swapper/221:14:592
753356991310,2cyclictest777338-21kthreadcore19:35:182
753356991310,2cyclictest1956849-21systemd-journal19:50:032
753356991310,2cyclictest0-21swapper/220:30:012
75335699130,8cyclictest786363-21cron19:45:002
75335699130,8cyclictest786363-21cron19:45:002
75335499130,11cyclictest969129-21kthreadcore23:00:191
75335499130,10cyclictest989170-21latency_hist23:30:001
75336199129,2cyclictest0-21swapper/322:50:003
75336199128,3cyclictest769055-21kworker/u8:1+events_unbound20:00:253
753361991210,1cyclictest0-21swapper/322:30:013
75336199120,3cyclictest1005192-21awk23:49:593
75335699129,2cyclictest0-21swapper/219:35:002
75335699126,4cyclictest989008-21latency_hist23:30:002
75336199118,2cyclictest848355-21kworker/u8:3+flush-259:020:55:263
75336199117,3cyclictest3002-21cron20:00:003
75336199117,2cyclictest972814-21sort23:10:113
75336199115,4cyclictest880048-21cron21:14:593
75335699119,1cyclictest0-21swapper/223:35:162
75335699119,1cyclictest0-21swapper/222:20:002
75335699118,1cyclictest0-21swapper/222:30:132
75335699117,3cyclictest885858-21kworker/u8:2+flush-259:022:08:002
75335099117,3cyclictest885858-21kworker/u8:2+events_unbound22:25:300
75336199107,2cyclictest781552-21cpuspeed_turbos19:40:153
75336199107,2cyclictest781552-21cpuspeed_turbos19:40:153
75336199107,1cyclictest0-21swapper/321:26:483
75336199106,3cyclictest999779-21cut23:40:163
75336199100,8cyclictest1032078-21awk00:20:003
75336199100,4cyclictest843313-21cat20:40:013
75336199100,3cyclictest908066-21latency_hist21:50:003
75335699107,2cyclictest902608-21cpuspeed_turbos21:40:132
75335699106,3cyclictest988009-21sshd23:20:572
75335699105,3cyclictest1956849-21systemd-journal23:10:012
75335099106,3cyclictest939613-21kworker/u8:0+events_unbound22:45:100
7533569991,6cyclictest940234-21idleruntime-cro22:30:012
7533569991,6cyclictest908047-21cron21:50:012
7533569991,6cyclictest812571-21seq20:10:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional