You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-19 - 02:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat Apr 18, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
968699280,22cyclictest14832-21fschecks_time10:24:583
968699280,1cyclictest0-21swapper/311:45:033
968699280,0cyclictest0-21swapper/311:13:503
9686992723,4cyclictest0-21swapper/311:52:223
9686992719,7cyclictest3116-21if_enp1s0.810:44:593
968699270,26cyclictest0-21swapper/311:07:583
968699260,1cyclictest0-21swapper/309:25:173
967999260,0cyclictest0-21swapper/111:59:511
967699260,25cyclictest0-21swapper/011:03:240
9686992523,1cyclictest24177-21apt-get12:09:563
9686992521,2cyclictest313-21systemd-journal07:55:003
9686992520,4cyclictest31627-21ssh09:37:593
9686992520,4cyclictest0-21swapper/309:54:273
9686992518,6cyclictest26998-21basename10:05:003
968699250,24cyclictest0-21swapper/312:26:383
9683992521,3cyclictest606-21dbus-daemon11:00:002
968399250,24cyclictest3166-21diskmemload12:37:192
967999250,24cyclictest10737-21ssh11:24:531
967999250,24cyclictest0-21swapper/109:15:421
967699250,24cyclictest21316-21ssh12:37:250
967699250,1cyclictest3166-21diskmemload10:27:510
9686992420,3cyclictest3166-21diskmemload11:24:453
9686992420,3cyclictest3166-21diskmemload10:06:543
9686992419,5cyclictest0-21swapper/309:24:563
9686992419,4cyclictest0-21swapper/309:19:003
9686992417,6cyclictest10556-21ssh10:20:013
9686992417,3cyclictest0-21swapper/312:04:593
9686992415,5cyclictest27334-21sh09:34:223
968699240,24cyclictest0-21swapper/311:42:083
968699240,21cyclictest0-21swapper/310:57:173
968699240,1cyclictest24082-21ssh11:36:483
968699240,0cyclictest0-21swapper/310:51:413
968699240,0cyclictest0-21swapper/310:47:553
968699240,0cyclictest0-21swapper/309:58:363
968699240,0cyclictest0-21swapper/309:46:243
9683992419,4cyclictest0-21swapper/211:52:372
968399241,0cyclictest0-21swapper/210:16:192
968399240,24cyclictest0-21swapper/209:34:372
968399240,23cyclictest0-21swapper/212:21:172
968399240,23cyclictest0-21swapper/209:43:052
968399240,1cyclictest8132-21kworker/u8:111:21:412
9679992424,0cyclictest0-21swapper/112:32:551
9679992423,1cyclictest0-21swapper/112:20:521
9679992421,2cyclictest8256-21wc09:15:001
967999240,24cyclictest0-21swapper/111:45:001
967999240,23cyclictest28354-21munin-plugin-st08:55:011
967999240,0cyclictest0-21swapper/110:08:331
967699240,24cyclictest0-21swapper/012:00:140
967699240,24cyclictest0-21swapper/011:13:110
967699240,23cyclictest3166-21diskmemload10:21:520
967699240,23cyclictest22318-21ntpq11:35:010
967699240,23cyclictest0-21swapper/012:10:010
967699240,23cyclictest0-21swapper/011:53:390
967699240,23cyclictest0-21swapper/011:18:360
967699240,23cyclictest0-21swapper/009:34:550
9686992323,0cyclictest3166-21diskmemload10:35:453
9686992323,0cyclictest0-21swapper/312:10:283
9686992323,0cyclictest0-21swapper/311:01:203
9686992321,1cyclictest3166-21diskmemload11:35:003
9686992321,1cyclictest0-21swapper/312:37:033
9686992320,3cyclictest0-21swapper/312:31:313
9686992320,2cyclictest313-21systemd-journal07:25:013
9686992319,3cyclictest3166-21diskmemload11:15:313
9686992319,3cyclictest0-21swapper/310:32:293
968699230,2cyclictest12758-21sh11:58:003
968699230,23cyclictest0-21swapper/309:43:153
968699230,1cyclictest3166-21diskmemload12:15:273
968699230,0cyclictest0-21swapper/312:22:043
9683992323,0cyclictest3166-21diskmemload12:02:162
9683992323,0cyclictest0-21swapper/210:46:162
9683992323,0cyclictest0-21swapper/210:39:402
9683992321,1cyclictest3014-21ssh10:13:052
9683992321,1cyclictest0-21swapper/212:26:352
9683992321,1cyclictest0-21swapper/209:20:462
9683992321,0cyclictest0-21swapper/210:02:342
9683992320,2cyclictest26471-21ssh11:07:462
9683992317,2cyclictest11755-21rm10:20:402
968399231,21cyclictest3166-21diskmemload10:40:052
968399230,23cyclictest3166-21diskmemload12:32:272
968399230,23cyclictest0-21swapper/212:13:152
968399230,23cyclictest0-21swapper/211:59:342
968399230,23cyclictest0-21swapper/209:17:452
968399230,22cyclictest28071-21ssh10:05:142
968399230,22cyclictest19460-21awk07:30:012
968399230,0cyclictest13356-21kworker/u8:011:36:182
968399230,0cyclictest0-21swapper/212:07:432
968399230,0cyclictest0-21swapper/211:10:182
968399230,0cyclictest0-21swapper/209:26:192
9679992323,0cyclictest3166-21diskmemload12:17:511
9679992323,0cyclictest0-21swapper/112:25:501
9679992323,0cyclictest0-21swapper/110:38:451
9679992323,0cyclictest0-21swapper/109:40:441
9679992322,1cyclictest6810-21ssh10:16:011
9679992321,1cyclictest19741-21ssh12:04:581
9679992321,1cyclictest0-21swapper/110:21:171
9679992320,2cyclictest22058-21ssh10:30:581
9679992320,2cyclictest16511-21sh10:25:171
967999230,2cyclictest15046-21ssh10:55:481
967999230,23cyclictest3166-21diskmemload11:02:011
967999230,23cyclictest0-21swapper/111:50:271
967999230,23cyclictest0-21swapper/111:39:381
967999230,23cyclictest0-21swapper/110:50:121
967999230,22cyclictest15190-21sh11:28:551
967999230,22cyclictest0-21swapper/109:52:311
967999230,1cyclictest29799-21apt-get08:59:561
967999230,0cyclictest3166-21diskmemload09:47:581
967999230,0cyclictest3166-21diskmemload09:30:031
9676992323,0cyclictest0-21swapper/009:43:390
9676992321,1cyclictest0-21swapper/012:05:260
9676992321,1cyclictest0-21swapper/011:05:450
9676992321,1cyclictest0-21swapper/009:10:580
9676992321,1cyclictest0-21swapper/007:15:010
967699230,23cyclictest0-21swapper/011:57:070
967699230,23cyclictest0-21swapper/011:23:080
967699230,23cyclictest0-21swapper/010:40:460
967699230,22cyclictest3166-21diskmemload12:25:020
967699230,22cyclictest27406-21apt-get08:54:570
967699230,22cyclictest19760-21ssh09:58:160
967699230,22cyclictest11354-21sh09:18:120
967699230,22cyclictest0-21swapper/010:01:530
967699230,22cyclictest0-21swapper/009:26:100
967699230,21cyclictest0-21swapper/009:50:580
967699230,1cyclictest0-21swapper/012:31:580
967699230,0cyclictest0-21swapper/011:25:550
967699230,0cyclictest0-21swapper/010:31:290
968699220,21cyclictest3200-21turbostat09:10:013
968699220,21cyclictest3166-21diskmemload09:10:133
968699220,21cyclictest16944-21sh10:25:563
968699220,21cyclictest0-21swapper/308:44:553
968699220,1cyclictest313-21systemd-journal08:55:013
968699220,1cyclictest15406-21apt-get08:29:563
9683992220,1cyclictest31005-21ssh12:15:012
9683992220,1cyclictest10553-21ssh10:51:452
9683992220,1cyclictest0-21swapper/210:30:252
9683992220,1cyclictest0-21swapper/209:55:542
9683992220,1cyclictest0-21swapper/209:10:462
9683992219,2cyclictest15672-21smartctl10:25:012
968399220,21cyclictest4041-21cron08:05:012
968399220,21cyclictest3166-21diskmemload09:51:112
968399220,21cyclictest26666-21memory07:45:002
968399220,21cyclictest22613-21apt-get08:44:562
968399220,21cyclictest0-21swapper/211:40:022
968399220,21cyclictest0-21swapper/208:59:562
968399220,1cyclictest29984-21ssh09:35:192
968399220,1cyclictest2150-21ssh11:15:022
968399220,1cyclictest0-21swapper/211:26:002
968399220,1cyclictest0-21swapper/211:03:022
968399220,0cyclictest3166-21diskmemload11:46:282
9679992222,0cyclictest0-21swapper/112:36:311
9679992222,0cyclictest0-21swapper/112:14:301
9679992222,0cyclictest0-21swapper/111:10:431
9679992220,1cyclictest14572-21apt07:20:011
9679992220,1cyclictest0-21swapper/111:15:241
9679992220,1cyclictest0-21swapper/108:35:001
967999220,2cyclictest26864-21ssh11:08:211
967999220,22cyclictest3166-21diskmemload12:08:591
967999220,22cyclictest0-21swapper/110:11:401
967999220,21cyclictest23033-21ssh10:00:161
967999220,21cyclictest0-21swapper/111:30:141
967999220,1cyclictest4545-21rm10:45:141
967999220,1cyclictest19405-21cat09:25:041
967999220,1cyclictest0-21swapper/109:56:031
967999220,1cyclictest0-21swapper/109:23:391
967999220,0cyclictest0-21swapper/109:35:161
9676992222,0cyclictest3166-21diskmemload10:05:230
9676992220,1cyclictest31001-21ntp_states12:15:010
9676992220,1cyclictest1420-21awk08:00:000
9676992220,1cyclictest0-21swapper/010:45:130
967699220,22cyclictest0-21swapper/010:15:510
967699220,22cyclictest0-21swapper/009:46:060
967699220,21cyclictest641-21irqstats09:05:010
967699220,21cyclictest4679-21ssh12:20:150
967699220,21cyclictest1557-21rm10:10:500
967699220,21cyclictest0-21swapper/008:59:560
967699220,21cyclictest0-21swapper/007:54:550
967699220,1cyclictest774-21runrttasks11:30:510
967699220,1cyclictest0-21swapper/011:41:230
967699220,1cyclictest0-21swapper/010:35:040
9686992120,1cyclictest13306-21ssh11:25:563
968699210,21cyclictest0-21swapper/310:10:233
968699210,21cyclictest0-21swapper/307:44:553
968699210,20cyclictest0-21swapper/307:59:573
968699210,20cyclictest0-21swapper/307:29:573
968699210,0cyclictest0-21swapper/307:19:573
9683992121,0cyclictest0-21swapper/209:46:012
9683992121,0cyclictest0-21swapper/208:24:572
9683992119,1cyclictest1391-21turbostat08:00:002
968399210,20cyclictest32216-21apt-get09:04:572
968399210,20cyclictest25956-21munin-run08:50:002
968399210,20cyclictest0-21swapper/211:30:032
968399210,20cyclictest0-21swapper/208:29:562
968399210,20cyclictest0-21swapper/207:14:562
967999210,0cyclictest23347-21apt-get07:39:561
9676992121,0cyclictest62550irq/127-eno111:45:120
9676992121,0cyclictest21892-21perf07:35:010
9676992121,0cyclictest20201-21apt-get08:39:560
9676992121,0cyclictest0-21swapper/008:29:560
967699210,21cyclictest0-21swapper/009:35:100
967699210,21cyclictest0-21swapper/009:20:190
967699210,20cyclictest0-21swapper/008:49:570
967699210,20cyclictest0-21swapper/008:44:560
967699210,20cyclictest0-21swapper/007:19:570
9686992020,0cyclictest11243-21apt-get07:14:563
9686992020,0cyclictest0-21swapper/308:09:563
9686992020,0cyclictest0-21swapper/308:09:563
968699200,0cyclictest0-21swapper/309:04:573
968699200,0cyclictest0-21swapper/307:39:563
9683992019,1cyclictest0-21swapper/207:34:562
9683992018,1cyclictest4060-21apt-get08:05:022
9683992018,1cyclictest4060-21apt-get08:05:022
9679992020,0cyclictest0-21swapper/108:19:551
9679992020,0cyclictest0-21swapper/108:05:021
9679992020,0cyclictest0-21swapper/108:05:021
9679992020,0cyclictest0-21swapper/107:14:561
967999200,0cyclictest0-21swapper/108:14:541
9676992020,0cyclictest0-21swapper/008:04:550
9676992020,0cyclictest0-21swapper/007:49:550
9676992020,0cyclictest0-21swapper/007:24:570
9676992018,1cyclictest0-21swapper/008:05:020
9676992018,1cyclictest0-21swapper/008:05:020
9676992017,2cyclictest3227-21latency_hist09:10:010
967699200,0cyclictest0-21swapper/007:29:560
9686991919,0cyclictest0-21swapper/308:34:543
9686991918,1cyclictest8188-21apt-get08:14:543
9683991919,0cyclictest0-21swapper/209:09:572
9683991918,0cyclictest0-21swapper/208:14:542
9679991918,0cyclictest540-21apt-get07:59:571
9686991818,0cyclictest0-21swapper/308:19:563
9686991818,0cyclictest0-21swapper/308:04:563
9683991818,0cyclictest0-21swapper/208:39:562
9679991816,1cyclictest313-21systemd-journal07:45:001
9676991818,0cyclictest25763-21apt-get07:44:560
9683991717,0cyclictest30550-21apt-get07:54:562
9683991714,2cyclictest606-21dbus-daemon07:40:002
9679991717,0cyclictest0-21swapper/108:49:571
9679991717,0cyclictest0-21swapper/108:24:571
9679991714,2cyclictest643-21awk09:05:011
967999170,16cyclictest30777-21expr07:54:561
9686991615,1cyclictest0-21swapper/307:49:553
9683991616,0cyclictest13641-21apt-get07:19:572
9683991616,0cyclictest10595-21apt-get08:19:562
9683991616,0cyclictest0-21swapper/207:24:572
9676991614,1cyclictest0-21swapper/008:34:540
9683991515,0cyclictest0-21swapper/208:54:562
9683991513,1cyclictest29316-21munin-run07:50:002
9679991514,0cyclictest0-21swapper/109:09:571
9686991414,0cyclictest0-21swapper/308:45:013
9686991414,0cyclictest0-21swapper/307:30:093
968699140,14cyclictest0-21swapper/308:55:233
968699140,14cyclictest0-21swapper/308:20:373
968699140,0cyclictest0-21swapper/308:35:103
968399140,0cyclictest0-21swapper/208:31:032
967999140,14cyclictest0-21swapper/108:41:071
967999140,14cyclictest0-21swapper/107:45:271
967999140,0cyclictest0-21swapper/108:01:301
967999140,0cyclictest0-21swapper/107:20:131
9676991414,0cyclictest0-21swapper/008:20:470
9676991414,0cyclictest0-21swapper/008:15:060
9676991414,0cyclictest0-21swapper/007:35:070
967699140,0cyclictest0-21swapper/008:10:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional