You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-06 - 19:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Fri Mar 06, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
870817995148,2cyclictest75-21kswapd012:07:423
870817995148,2cyclictest75-21kswapd012:07:423
870807995147,3cyclictest1177646-21kworker/u8:0+flush-259:012:07:590
870807995147,3cyclictest1177646-21kworker/u8:0+flush-259:012:07:590
870810994744,2cyclictest75-21kswapd012:07:411
870810994744,2cyclictest75-21kswapd012:07:411
870810993431,2cyclictest948763-21kworker/u8:0+flush-259:010:00:211
870810993330,2cyclictest948763-21kworker/u8:0+events_unbound09:15:161
870817993225,5cyclictest1006299-21diskstats09:20:133
870810993229,2cyclictest901772-21kworker/u8:1+flush-259:008:00:151
870817993125,4cyclictest1069104-21/usr/sbin/munin10:20:143
870810993128,2cyclictest948763-21kworker/u8:0+flush-259:009:45:161
870810993027,2cyclictest928271-21kworker/u8:3+events_unbound08:35:211
870815992825,2cyclictest75-21kswapd012:07:422
870815992825,2cyclictest75-21kswapd012:07:422
870807992824,3cyclictest1198321-21kworker/u8:2+flush-259:012:25:150
870810992725,2cyclictest959472-21kworker/u8:2+flush-259:009:10:161
870810992723,2cyclictest1161784-21kworker/u8:4+flush-259:011:55:001
87080799271,24cyclictest1042368-21munin-run09:55:010
870810992623,2cyclictest948763-21kworker/u8:0+events_unbound09:25:151
870810992621,4cyclictest916771-21ntpq07:50:211
870810992519,5cyclictest1093642-21ntpq10:40:201
870810992422,1cyclictest948763-21kworker/u8:0+events_unbound10:20:211
870810992421,2cyclictest1146335-21apt-get11:35:101
870810992421,2cyclictest1074030-21kworker/u8:3+events_unbound11:20:191
870810992420,3cyclictest1198535-21kworker/u8:4+flush-259:012:35:141
870810992419,4cyclictest1099993-21apt-get10:50:141
870807992420,3cyclictest928271-21kworker/u8:3+flush-259:008:35:160
870807992420,3cyclictest1181688-21kworker/u8:3+events_unbound12:15:170
870807992419,4cyclictest1001115-21diskstats09:15:150
870815992320,2cyclictest1198569-21apt-get12:25:122
870810992320,2cyclictest969787-21kworker/u8:1+flush-259:008:50:011
870810992320,2cyclictest152928-21kworker/u8:2+events_unbound07:35:171
870810992320,2cyclictest1181688-21kworker/u8:3+events_unbound12:10:151
870810992320,2cyclictest1181688-21kworker/u8:3+events_unbound12:10:151
870810992320,2cyclictest1115170-21kworker/u8:2+events_unbound11:40:231
870810992320,2cyclictest1042348-21gpgv09:54:591
870807992320,2cyclictest1187798-21kworker/u8:2+flush-259:012:15:000
870807992320,2cyclictest1187798-21kworker/u8:2+flush-259:012:15:000
870807992320,2cyclictest1074030-21kworker/u8:3+flush-259:011:20:170
870807992316,5cyclictest875035-21ntpq07:10:200
870815992215,5cyclictest252-21systemd-journal11:39:402
870810992220,2cyclictest1198321-21kworker/u8:2+flush-259:012:30:151
870810992219,2cyclictest959472-21kworker/u8:2+events_unbound09:00:191
870810992218,3cyclictest959472-21kworker/u8:2+flush-259:008:40:101
870810992218,3cyclictest865834-21kworker/u8:0+events_unbound07:10:181
870807992216,4cyclictest890579-21ntpq07:25:210
870807992216,4cyclictest890579-21ntpq07:25:200
87080799221,20cyclictest1-21systemd11:01:400
870817992115,4cyclictest1193429-21apt-get12:20:113
870815992116,3cyclictest886267-21latency_hist07:25:012
870810992119,2cyclictest959472-21kworker/u8:2+events_unbound09:05:231
870810992118,2cyclictest1198321-21kworker/u8:2+events_unbound12:25:181
870810992118,1cyclictest0-21swapper/108:00:011
870810992117,3cyclictest948763-21kworker/u8:0+events_unbound11:15:191
870810992117,3cyclictest1115170-21kworker/u8:2+events_unbound12:00:221
870810992117,3cyclictest1011039-21kworker/u8:2+flush-259:009:30:201
870807992118,2cyclictest865834-21kworker/u8:0+events_unbound07:40:150
870807992117,3cyclictest1115170-21kworker/u8:2+flush-259:011:40:200
870817992016,2cyclictest0-21swapper/307:40:003
870815992016,3cyclictest1074030-21kworker/u8:3+flush-259:010:50:192
870815992016,3cyclictest1042317-21sh09:54:592
870815992015,4cyclictest959472-21kworker/u8:2+flush-259:008:40:152
870815992013,5cyclictest896615-21latency_hist07:35:012
870810992017,2cyclictest928271-21kworker/u8:3+flush-259:008:20:211
870807992017,2cyclictest1074030-21kworker/u8:3+events_unbound11:30:240
870807992017,2cyclictest1031595-21kworker/u8:1+events_unbound09:55:150
870807992016,3cyclictest959472-21kworker/u8:2+events_unbound08:40:120
870807992016,3cyclictest1031595-21kworker/u8:1+flush-259:010:40:220
870807992015,4cyclictest1084262-21latency_hist10:35:010
870817991914,3cyclictest1104869-21kworker/u8:1+flush-259:010:55:253
870817991913,4cyclictest1166760-21latency_hist11:55:003
870817991911,6cyclictest1063815-21cat10:15:013
870810991916,2cyclictest938405-21kworker/u8:1+events_unbound08:15:161
870810991916,2cyclictest928271-21kworker/u8:3+flush-259:008:05:241
870810991916,2cyclictest865834-21kworker/u8:0+flush-259:007:25:531
870810991916,2cyclictest865834-21kworker/u8:0+flush-259:007:25:521
870810991916,2cyclictest1104869-21kworker/u8:1+flush-259:010:55:211
870810991916,2cyclictest1031595-21kworker/u8:1+flush-259:010:25:241
870810991915,3cyclictest969787-21kworker/u8:1+events_unbound09:20:201
870807991915,3cyclictest948763-21kworker/u8:0+events_unbound10:10:200
870807991915,3cyclictest1156410-21kworker/u8:1+flush-259:011:50:200
870817991815,2cyclictest980130-21latency_hist08:55:013
870817991813,4cyclictest152928-21kworker/u8:2+flush-259:007:25:013
870817991812,5cyclictest1078272-21ntpq10:25:223
870817991812,4cyclictest943573-21latency_hist08:20:003
870810991815,2cyclictest1181688-21kworker/u8:3+events_unbound12:15:151
870810991814,3cyclictest948763-21kworker/u8:0+flush-259:010:30:151
870810991814,3cyclictest1161784-21kworker/u8:4+flush-259:011:55:211
870807991815,2cyclictest959472-21kworker/u8:2+flush-259:008:50:210
870807991815,2cyclictest928271-21kworker/u8:3+flush-259:008:28:560
870807991815,2cyclictest1074030-21kworker/u8:3+events_unbound10:50:230
870807991814,3cyclictest948763-21kworker/u8:0+events_unbound11:47:400
870807991814,3cyclictest948763-21kworker/u8:0+events_unbound10:15:110
870807991814,3cyclictest1181688-21kworker/u8:3+events_unbound12:20:260
87080799181,15cyclictest252-21systemd-journal12:05:000
870817991714,2cyclictest0-21swapper/308:30:013
870817991710,5cyclictest907429-21cat07:45:013
870815991713,3cyclictest1099722-21sh10:50:002
870815991710,5cyclictest907054-21cat07:45:012
870810991714,2cyclictest865834-21kworker/u8:0+flush-259:007:40:161
870810991714,2cyclictest1115170-21kworker/u8:2+flush-259:011:45:251
870810991714,2cyclictest1074030-21kworker/u8:3+flush-259:010:45:211
870810991713,3cyclictest1115170-21kworker/u8:2+events_unbound11:30:121
870810991712,3cyclictest1120545-21/usr/sbin/munin11:10:181
870810991710,5cyclictest1042838-21cat09:55:011
870807991714,2cyclictest61150irq/133-enp0s29f1:tx-012:35:210
870807991714,2cyclictest61150irq/133-enp0s29f1:tx-007:55:150
870807991714,2cyclictest60350irq/132-enp0s29f1:rx-010:37:460
870807991713,3cyclictest948763-21kworker/u8:0+flush-259:009:49:030
870807991713,3cyclictest948763-21kworker/u8:0+events_unbound09:40:140
870807991713,3cyclictest901772-21kworker/u8:1+events_unbound07:45:220
870807991713,3cyclictest1115170-21kworker/u8:2+events_unbound11:55:140
870817991613,2cyclictest1053684-21irqcore10:05:173
870817991612,3cyclictest948763-21kworker/u8:0+flush-259:011:10:163
87081599169,5cyclictest1166765-21turbostat11:55:002
870815991613,2cyclictest1079167-21idleruntime-cro10:30:002
870815991611,4cyclictest980392-21apt-get08:55:112
87081599161,10cyclictest933224-21munin-run08:10:002
870815991610,4cyclictest870991-21munin-node07:10:112
870810991613,2cyclictest959472-21kworker/u8:2+events_unbound08:50:261
870810991613,2cyclictest938405-21kworker/u8:1+events_unbound08:34:401
870810991613,2cyclictest152928-21kworker/u8:2+events_unbound07:20:231
870810991613,2cyclictest152928-21kworker/u8:2+events_unbound07:15:151
870810991613,2cyclictest1156410-21kworker/u8:1+flush-259:012:20:181
870810991613,2cyclictest1027142-21irqcore09:40:171
870810991612,3cyclictest948763-21kworker/u8:0+events_unbound10:15:091
870810991612,2cyclictest0-21swapper/108:10:181
870807991614,1cyclictest60350irq/132-enp0s29f1:rx-010:25:240
870807991614,1cyclictest1074030-21kworker/u8:3+flush-259:011:15:010
870807991613,2cyclictest60350irq/132-enp0s29f1:rx-009:35:010
870807991613,2cyclictest60350irq/132-enp0s29f1:rx-009:05:110
870807991613,2cyclictest60350irq/132-enp0s29f1:rx-008:30:220
870807991613,2cyclictest60350irq/132-enp0s29f1:rx-008:15:130
870807991612,3cyclictest1074030-21kworker/u8:3+flush-259:011:09:220
87081799159,4cyclictest252-21systemd-journal10:31:403
87081799155,9cyclictest0-21swapper/308:15:013
870817991512,2cyclictest1089393-21idleruntime-cro10:39:593
870817991511,2cyclictest0-21swapper/309:40:003
870817991510,3cyclictest948763-21kworker/u8:0+flush-259:009:45:163
870817991510,3cyclictest1177109-21gpgv12:05:003
87081599159,4cyclictest1026451-21sh09:40:002
87081599154,6cyclictest1209066-21idleruntime-cro12:35:002
870815991512,2cyclictest899163-21kthreadcore07:35:182
870815991512,2cyclictest1112558-21kthreadcore11:00:172
870815991512,1cyclictest0-21swapper/209:50:002
870815991511,3cyclictest901772-21kworker/u8:1+flush-259:007:55:212
870810991513,2cyclictest928271-21kworker/u8:3+events_unbound08:28:531
870810991512,2cyclictest948763-21kworker/u8:0+events_unbound11:25:181
870810991512,2cyclictest1074030-21kworker/u8:3+events_unbound10:38:411
870807991513,2cyclictest948763-21kworker/u8:0+flush-259:009:25:250
870807991513,2cyclictest60350irq/132-enp0s29f1:rx-007:18:510
870807991513,1cyclictest60350irq/132-enp0s29f1:rx-008:45:510
870807991512,2cyclictest948763-21kworker/u8:0+flush-259:011:25:230
870807991512,2cyclictest60350irq/132-enp0s29f1:rx-010:05:220
870807991512,2cyclictest60350irq/132-enp0s29f1:rx-009:10:120
870807991512,2cyclictest60350irq/132-enp0s29f1:rx-008:55:100
870807991512,2cyclictest60350irq/132-enp0s29f1:rx-008:21:430
870807991511,3cyclictest901772-21kworker/u8:1+events_unbound07:53:490
870807991511,3cyclictest152928-21kworker/u8:2+flush-259:007:35:000
870807991511,3cyclictest1104869-21kworker/u8:1+flush-259:010:55:200
87080799150,13cyclictest1-21systemd11:19:400
87081799147,5cyclictest968918-21ntpq08:40:203
87081799147,5cyclictest252-21systemd-journal09:44:593
870817991411,2cyclictest906927-21gpgv07:45:003
870817991411,2cyclictest1156410-21kworker/u8:1+flush-259:012:19:113
870817991411,2cyclictest1100401-21grep10:50:193
870817991411,2cyclictest1098797-21ntp_kernel_err10:45:203
870817991410,3cyclictest991092-21sed09:05:173
870815991411,2cyclictest1213340-21ntp_kernel_pll_12:35:212
870815991410,3cyclictest928271-21kworker/u8:3+flush-259:008:25:012
870815991410,3cyclictest1115170-21kworker/u8:2+flush-259:012:00:172
870810991411,2cyclictest948763-21kworker/u8:0+events_unbound09:38:361
870810991411,2cyclictest1031595-21kworker/u8:1+events_unbound10:14:421
870810991410,3cyclictest959472-21kworker/u8:2+flush-259:008:55:151
870810991410,3cyclictest865834-21kworker/u8:0+events_unbound07:49:161
870807991413,1cyclictest60350irq/132-enp0s29f1:rx-010:48:120
870807991412,2cyclictest60350irq/132-enp0s29f1:rx-007:21:090
870807991412,1cyclictest60350irq/132-enp0s29f1:rx-008:02:040
870807991411,2cyclictest60350irq/132-enp0s29f1:rx-007:39:500
870807991410,3cyclictest1031595-21kworker/u8:1+events_unbound10:25:010
87081799139,3cyclictest928271-21kworker/u8:3+flush-259:008:05:363
87081799139,3cyclictest1130942-21cpuspeed_turbos11:20:133
87081799139,3cyclictest1104869-21kworker/u8:1+flush-259:011:00:513
87081799138,3cyclictest252-21systemd-journal11:15:403
870817991311,1cyclictest2109693-21snmpd12:12:373
870817991311,1cyclictest2109693-21snmpd12:12:373
870817991311,1cyclictest0-21swapper/309:55:013
87081599139,3cyclictest948763-21kworker/u8:0+flush-259:011:25:192
87081599139,3cyclictest907565-21/usr/sbin/munin07:45:202
87081599138,3cyclictest1115170-21kworker/u8:2+flush-259:011:40:222
870815991310,2cyclictest152928-21kworker/u8:2+flush-259:007:15:152
870815991310,2cyclictest1084255-21sh10:35:002
87081099139,3cyclictest1074030-21kworker/u8:3+events_unbound11:07:251
870810991310,2cyclictest865834-21kworker/u8:0+events_unbound07:30:131
87080799139,3cyclictest969787-21kworker/u8:1+flush-259:009:20:140
87080799139,3cyclictest959472-21kworker/u8:2+flush-259:009:00:230
870807991312,1cyclictest60350irq/132-enp0s29f1:rx-008:05:170
870807991311,2cyclictest60350irq/132-enp0s29f1:rx-010:02:230
87081799129,2cyclictest987823-21kthreadcore09:00:183
87081799129,2cyclictest923195-21cpuspeed_turbos08:00:143
87081799129,2cyclictest915067-21kthreadcore07:50:173
87081799129,2cyclictest886948-21sed07:25:153
87081799129,2cyclictest886948-21sed07:25:153
87081799129,2cyclictest873329-21kthreadcore07:10:183
87081799129,2cyclictest1167092-21cpuspeed_turbos11:55:133
87081799128,3cyclictest1115170-21kworker/u8:2+flush-259:011:30:113
87081799127,3cyclictest948763-21kworker/u8:0+flush-259:011:35:523
870817991210,1cyclictest0-21swapper/307:55:163
87081599129,2cyclictest1125508-21idleruntime-cro11:15:012
87081599129,2cyclictest1011671-21cut09:25:162
87081599128,2cyclictest17550irq/130-nvme0q310:15:002
87081599127,3cyclictest990035-21sshd09:00:392
87081599127,3cyclictest937576-21smartctl08:10:222
87081599127,3cyclictest1161549-21latency_hist11:50:002
87081599127,3cyclictest1021280-21cron09:35:002
87081599126,4cyclictest252-21systemd-journal07:30:002
87081599126,4cyclictest252-21systemd-journal07:30:002
870815991210,1cyclictest0-21swapper/210:00:002
87080799129,2cyclictest60350irq/132-enp0s29f1:rx-011:35:090
87080799129,2cyclictest60350irq/132-enp0s29f1:rx-009:35:450
87081799116,3cyclictest1209290-21/usr/sbin/munin12:35:203
87081799115,4cyclictest1203615-21base6412:30:003
87081599118,2cyclictest975297-21cpuspeed_turbos08:50:122
87081599117,3cyclictest948763-21kworker/u8:0+flush-259:010:00:112
87081599117,3cyclictest401ktimers/210:35:222
87081599117,3cyclictest401ktimers/208:15:112
87081599117,2cyclictest1146070-21latency_hist11:35:002
87081599117,2cyclictest1065789-21kthreadcore10:15:162
87081799108,1cyclictest0-21swapper/311:25:193
87081799105,3cyclictest1017694-21cut09:30:183
87081599108,1cyclictest0-21swapper/207:50:152
87081599106,2cyclictest0-21swapper/210:20:192
8708159997,1cyclictest0-21swapper/209:40:142
8708159995,2cyclictest0-21swapper/211:55:172
8708179986,1cyclictest0-21swapper/309:25:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional