You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-24 - 14:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Fri Jul 24, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
949790995348,3cyclictest991585-21kworker/u8:2+flush-259:020:00:251
949794995144,5cyclictest1236296-21cat23:45:012
949788994134,5cyclictest335557-21systemd-journal19:15:000
949794993834,3cyclictest1188265-21kworker/u8:1+flush-259:023:00:012
949798993633,2cyclictest1208929-21kworker/u8:0+flush-259:023:30:263
949798993630,4cyclictest335557-21systemd-journal20:10:253
949790993633,2cyclictest1172805-21kworker/u8:3+events_unbound23:40:171
949790993633,2cyclictest1172805-21kworker/u8:3+events_unbound23:40:161
949790993531,3cyclictest944621-21kworker/u8:0+flush-259:019:15:251
949790993529,4cyclictest335557-21systemd-journal00:39:271
949798993430,3cyclictest991585-21kworker/u8:2+flush-259:020:05:003
949790993431,2cyclictest1241286-21kworker/u8:2+flush-259:000:00:201
949790993329,3cyclictest1162494-21kworker/u8:0+flush-259:022:40:271
949788993327,4cyclictest1022621-21latency_hist20:20:010
94978899330,31cyclictest1-21systemd00:30:010
949790993229,2cyclictest991347-21kworker/u8:0+flush-259:020:20:181
949790993228,3cyclictest1188265-21kworker/u8:1+flush-259:023:09:591
949790993228,3cyclictest1074586-21apt-get21:10:131
949788993225,5cyclictest1006247-21ntpq20:00:220
949798993126,3cyclictest970454-21gpgv19:30:003
949790993127,3cyclictest1126535-21kworker/u8:2+flush-259:022:45:221
949790993127,2cyclictest1105728-21kworker/u8:1+flush-259:022:25:201
949790993126,4cyclictest1172805-21kworker/u8:3+flush-259:022:57:261
949788993126,3cyclictest1126535-21kworker/u8:2+flush-259:022:10:250
949790993026,3cyclictest1089823-21kworker/u8:3+events_unbound21:42:021
949790993023,4cyclictest1100478-21cp21:35:001
949788993025,3cyclictest1152410-21apt-get22:25:110
94978899301,27cyclictest1-21systemd23:15:000
949798992924,3cyclictest991347-21kworker/u8:0+flush-259:020:25:003
949794992925,3cyclictest1246436-21kworker/u8:4+flush-259:000:05:002
949794992925,3cyclictest1048714-21kworker/u8:4+flush-259:021:00:172
949790992925,3cyclictest944621-21kworker/u8:0+events_unbound19:36:371
949790992924,3cyclictest1219951-21apt-get23:30:111
949788992923,5cyclictest964337-21ntpq19:20:220
949788992923,5cyclictest964337-21ntpq19:20:220
949798992823,3cyclictest1172805-21kworker/u8:3+flush-259:022:50:263
949798992822,5cyclictest991827-21apt-get19:50:133
949798992821,5cyclictest1241265-21latency_hist23:50:003
949794992825,2cyclictest1032682-21kworker/u8:3+flush-259:020:35:272
949790992824,3cyclictest991347-21kworker/u8:0+events_unbound20:14:281
949790992824,3cyclictest960283-21kworker/u8:4+events_unbound19:32:271
949798992721,4cyclictest1126535-21kworker/u8:2+flush-259:022:05:003
949798992720,4cyclictest1126300-21latency_hist22:00:003
949794992722,4cyclictest1172805-21kworker/u8:3+flush-259:023:34:592
949790992724,2cyclictest1262235-21kworker/u8:3+flush-259:000:15:271
949790992723,3cyclictest944621-21kworker/u8:0+events_unbound19:27:271
949790992722,3cyclictest991585-21kworker/u8:2+events_unbound20:07:261
949788992723,3cyclictest1172805-21kworker/u8:3+flush-259:023:19:590
949788992722,4cyclictest1230577-21cat23:40:000
949788992722,4cyclictest1230577-21cat23:40:000
949788992721,4cyclictest1236347-21/usr/sbin/munin23:45:140
949798992619,5cyclictest1094965-21latency_hist21:30:013
949798992619,5cyclictest1063991-21latency_hist21:00:013
949794992621,4cyclictest1198975-21diskstats23:10:152
949790992623,2cyclictest3063306-21kworker/u8:3+events_unbound19:22:271
949790992623,2cyclictest3063306-21kworker/u8:3+events_unbound19:22:261
949790992623,2cyclictest1208929-21kworker/u8:0+events_unbound23:23:251
949790992623,2cyclictest1099991-21kworker/u8:0+events_unbound21:37:011
949790992622,3cyclictest991347-21kworker/u8:0+events_unbound20:25:231
949790992622,2cyclictest1115992-21kworker/u8:0+flush-259:022:15:271
949798992519,4cyclictest1126535-21kworker/u8:2+flush-259:022:10:013
949794992520,4cyclictest1266302-21ntpq00:10:222
949790992521,3cyclictest1208929-21kworker/u8:0+events_unbound23:56:271
949790992521,3cyclictest1089823-21kworker/u8:3+events_unbound21:53:261
949790992520,3cyclictest1126535-21kworker/u8:2+events_unbound22:10:121
949788992519,4cyclictest335557-21systemd-journal00:04:590
949798992421,2cyclictest1172805-21kworker/u8:3+events_unbound00:00:003
949798992420,3cyclictest1059043-21kworker/u8:1+flush-259:021:05:243
949798992416,5cyclictest1115979-21latency_hist21:50:003
949790992421,2cyclictest1126535-21kworker/u8:2+events_unbound22:35:201
949790992421,2cyclictest1069371-21kworker/u8:2+events_unbound21:15:241
949790992420,2cyclictest985998-21kworker/u8:1+events_unbound20:35:011
949790992416,6cyclictest335557-21systemd-journal20:45:001
949788992418,4cyclictest981239-21latency_hist19:40:010
949788992417,5cyclictest335557-21systemd-journal19:54:250
949788992417,5cyclictest1001062-21ntpq19:55:230
949798992319,3cyclictest1126535-21kworker/u8:2+flush-259:022:40:163
949798992318,4cyclictest1126535-21kworker/u8:2+events_unbound22:10:223
949794992320,2cyclictest1172805-21kworker/u8:3+flush-259:023:50:282
949794992320,2cyclictest1172805-21kworker/u8:3+flush-259:023:50:272
949794992319,3cyclictest1208929-21kworker/u8:0+flush-259:000:05:262
949794992318,4cyclictest944621-21kworker/u8:0+flush-259:019:30:002
949790992320,2cyclictest1069371-21kworker/u8:2+flush-259:021:20:211
949790992319,3cyclictest1048714-21kworker/u8:4+events_unbound20:56:251
949790992318,3cyclictest1262235-21kworker/u8:3+events_unbound00:25:191
949788992320,2cyclictest1084897-21apt-get21:20:140
949788992319,3cyclictest1053920-21/usr/sbin/munin20:50:150
949788992317,4cyclictest1026891-21ntpq20:20:190
949798992218,3cyclictest1126535-21kworker/u8:2+events_unbound22:35:173
949794992220,1cyclictest1089823-21kworker/u8:3+flush-259:021:40:012
949794992218,3cyclictest950006-21apt-get19:10:112
949794992216,4cyclictest1079477-21latency_hist21:15:002
949794992215,2cyclictest0-21swapper/223:24:592
949790992219,2cyclictest3063306-21kworker/u8:3+events_unbound19:10:141
949790992219,2cyclictest1208929-21kworker/u8:0+events_unbound23:51:271
949790992219,2cyclictest1208929-21kworker/u8:0+events_unbound23:51:261
949790992218,3cyclictest1115992-21kworker/u8:0+events_unbound22:20:131
949790992216,4cyclictest1229143-21ntpq23:35:191
949798992117,3cyclictest1172805-21kworker/u8:3+events_unbound23:10:193
949798992117,3cyclictest1048714-21kworker/u8:4+flush-259:020:45:273
949798992117,3cyclictest1048714-21kworker/u8:4+events_unbound21:00:273
949798992117,3cyclictest1032682-21kworker/u8:3+events_unbound20:35:213
949794992117,3cyclictest509-21rs:main2
949794992117,3cyclictest3063306-21kworker/u8:3+flush-259:019:35:252
949794992115,4cyclictest335557-21systemd-journal20:00:002
949790992118,2cyclictest991347-21kworker/u8:0+flush-259:020:50:251
949790992116,3cyclictest1111133-21apt-get21:45:141
949790992115,4cyclictest1188484-21/usr/sbin/munin23:00:151
949790992114,5cyclictest335557-21systemd-journal23:30:001
949788992116,4cyclictest1224027-21ntpq23:30:210
949798992017,2cyclictest1198779-21kworker/u8:4+events_unbound23:25:223
949798992013,5cyclictest335557-21systemd-journal20:51:243
949798992013,5cyclictest1037277-21ntpq20:30:203
949798992013,4cyclictest949980-21/usr/sbin/munin19:10:153
949794992016,3cyclictest1090071-21apt-get21:25:122
949794992015,3cyclictest1288569-21/usr/sbin/munin00:35:152
949794992014,4cyclictest335557-21systemd-journal21:00:002
94979499200,18cyclictest1272391-21munin-plugin-st00:20:002
94979099207,6cyclictest1043312-21munin-run20:40:001
949788992018,1cyclictest507-21in:imuxsock22:50:240
949788992014,4cyclictest1287902-21latency_hist00:35:010
949798991915,3cyclictest1262235-21kworker/u8:3+flush-259:000:20:163
949794991916,2cyclictest985998-21kworker/u8:1+flush-259:020:05:232
949794991915,3cyclictest1173024-21apt-get22:45:122
949790991916,2cyclictest1198779-21kworker/u8:4+events_unbound23:15:151
949790991915,2cyclictest944621-21kworker/u8:0+events_unbound19:40:251
949788991915,3cyclictest981505-21apt-get19:40:130
949788991914,3cyclictest1162717-21apt-get22:35:100
949788991913,4cyclictest975135-21ntpq19:30:200
949798991815,2cyclictest1100142-21apt-key21:35:003
949798991814,3cyclictest960283-21kworker/u8:4+flush-259:019:20:263
949798991814,3cyclictest960283-21kworker/u8:4+flush-259:019:20:263
949798991814,3cyclictest1262235-21kworker/u8:3+flush-259:000:30:443
949798991814,3cyclictest1262235-21kworker/u8:3+events_unbound00:25:233
949798991812,4cyclictest1152144-21latency_hist22:25:013
949794991814,3cyclictest1012552-21apt-get20:10:112
949790991815,2cyclictest1246436-21kworker/u8:4+flush-259:000:10:161
949790991814,3cyclictest991585-21kworker/u8:2+events_unbound19:50:301
949790991814,3cyclictest1208929-21kworker/u8:0+events_unbound23:45:141
949788991815,2cyclictest1115992-21kworker/u8:0+flush-259:022:20:250
949788991814,3cyclictest1120255-21ntp_kernel_pll_21:50:230
949788991813,4cyclictest1277564-21latency_hist00:25:010
949798991713,3cyclictest991347-21kworker/u8:0+events_unbound20:40:193
949798991710,5cyclictest335557-21systemd-journal19:46:253
949794991714,2cyclictest1035529-21kthreadcore20:30:162
949794991712,3cyclictest3063306-21kworker/u8:3+flush-259:019:25:002
949794991712,3cyclictest3063306-21kworker/u8:3+flush-259:019:25:002
949790991713,3cyclictest1105728-21kworker/u8:1+events_unbound21:55:211
949790991713,3cyclictest1048714-21kworker/u8:4+events_unbound21:00:131
949790991713,3cyclictest1048714-21kworker/u8:4+events_unbound20:46:261
949788991715,1cyclictest0-21swapper/023:30:010
949788991714,2cyclictest60350irq/132-enp0s29f1:rx-000:16:330
949788991714,2cyclictest0-21swapper/023:55:000
949788991714,2cyclictest0-21swapper/023:54:590
949788991712,3cyclictest1095221-21apt-get21:30:120
949798991611,3cyclictest1100960-21diskstats21:35:133
949794991614,1cyclictest1278245-21irqcore00:25:172
949794991613,2cyclictest1287914-21apt-get00:35:002
949794991612,3cyclictest1142105-21apt-get22:15:132
949790991613,2cyclictest3063306-21kworker/u8:3+flush-259:019:56:411
949790991613,2cyclictest1126535-21kworker/u8:2+flush-259:022:00:161
949790991612,3cyclictest1262235-21kworker/u8:3+events_unbound00:30:121
949788991614,2cyclictest60350irq/132-enp0s29f1:rx-020:09:430
949788991614,1cyclictest60350irq/132-enp0s29f1:rx-020:48:350
949788991612,3cyclictest1146997-21latency_hist22:20:010
949798991512,2cyclictest1172805-21kworker/u8:3+events_unbound23:05:003
949798991512,2cyclictest1116664-21irqcore21:50:193
949798991511,3cyclictest1198572-21kworker/u8:2+flush-259:023:20:163
949798991510,4cyclictest1262235-21kworker/u8:3+events_unbound00:35:193
949794991512,2cyclictest3063306-21kworker/u8:3+flush-259:019:55:002
949794991512,2cyclictest1147235-21/usr/sbin/munin22:20:192
949794991511,3cyclictest3063306-21kworker/u8:3+flush-259:019:45:002
949794991511,2cyclictest0-21swapper/223:39:592
949790991513,1cyclictest0-21swapper/122:10:001
949790991512,2cyclictest1105728-21kworker/u8:1+flush-259:022:30:161
949790991510,3cyclictest335557-21systemd-journal21:06:531
949788991513,1cyclictest60350irq/132-enp0s29f1:rx-023:21:440
949788991513,1cyclictest60350irq/132-enp0s29f1:rx-022:47:560
949788991513,1cyclictest60350irq/132-enp0s29f1:rx-022:32:440
949788991513,1cyclictest60350irq/132-enp0s29f1:rx-020:55:230
949788991513,1cyclictest60350irq/132-enp0s29f1:rx-020:10:310
949788991513,1cyclictest60350irq/132-enp0s29f1:rx-000:05:190
949788991512,2cyclictest60350irq/132-enp0s29f1:rx-023:01:290
949788991512,2cyclictest60350irq/132-enp0s29f1:rx-021:05:250
94978899151,13cyclictest1-21systemd21:04:250
94979899149,3cyclictest1172805-21kworker/u8:3+events_unbound23:35:143
94979899148,4cyclictest1256807-21latency_hist00:05:013
949798991411,2cyclictest1192503-21ntp_kernel_err23:00:233
949798991411,2cyclictest1172805-21kworker/u8:3+flush-259:023:50:233
949798991411,2cyclictest1172805-21kworker/u8:3+flush-259:023:50:233
94979899141,11cyclictest986375-21awk19:45:003
949798991410,3cyclictest1198779-21kworker/u8:4+flush-259:023:15:173
94979499149,4cyclictest1105955-21apt-get21:40:132
94979499149,3cyclictest1235895-21gpgv23:45:012
94979499149,3cyclictest1235895-21gpgv23:45:002
949794991411,2cyclictest1020015-21kthreadcore20:15:172
949794991411,1cyclictest0-21swapper/223:30:002
949794991411,1cyclictest0-21swapper/222:30:132
949794991410,3cyclictest1121481-21cpuspeed_turbos21:55:132
94978899149,4cyclictest1043542-21/usr/sbin/munin20:40:150
949788991413,1cyclictest60350irq/132-enp0s29f1:rx-023:36:440
949788991412,1cyclictest60350irq/132-enp0s29f1:rx-023:55:110
949788991412,1cyclictest60350irq/132-enp0s29f1:rx-022:58:140
949788991412,1cyclictest60350irq/132-enp0s29f1:rx-022:41:290
949788991412,1cyclictest60350irq/132-enp0s29f1:rx-021:28:260
949788991412,1cyclictest60350irq/132-enp0s29f1:rx-000:10:180
94979899139,2cyclictest0-21swapper/319:35:003
94979899138,3cyclictest1157280-21latency_hist22:30:003
94979499137,4cyclictest335557-21systemd-journal22:40:002
949794991310,2cyclictest959466-21timerwakeupswit19:15:252
949794991310,2cyclictest1131925-21fschecks_count22:05:162
949794991310,1cyclictest0-21swapper/220:25:152
949794991310,1cyclictest0-21swapper/219:30:162
949790991310,2cyclictest1172805-21kworker/u8:3+events_unbound23:10:251
949790991310,2cyclictest1172805-21kworker/u8:3+events_unbound22:50:291
949790991310,1cyclictest0-21swapper/119:45:241
949788991312,1cyclictest60350irq/132-enp0s29f1:rx-021:41:170
949788991312,1cyclictest60350irq/132-enp0s29f1:rx-019:26:280
949788991311,1cyclictest60350irq/132-enp0s29f1:rx-022:05:240
949788991311,1cyclictest60350irq/132-enp0s29f1:rx-021:45:190
949788991311,1cyclictest60350irq/132-enp0s29f1:rx-021:10:150
949788991311,1cyclictest60350irq/132-enp0s29f1:rx-020:25:150
949788991311,1cyclictest60350irq/132-enp0s29f1:rx-019:17:300
949788991310,2cyclictest60350irq/132-enp0s29f1:rx-023:05:160
949788991310,2cyclictest60350irq/132-enp0s29f1:rx-022:00:170
949788991310,2cyclictest60350irq/132-enp0s29f1:rx-021:55:130
949788991310,2cyclictest60350irq/132-enp0s29f1:rx-021:15:140
949788991310,2cyclictest60350irq/132-enp0s29f1:rx-000:35:120
94979899128,3cyclictest1267493-21apt-get00:15:143
94979899128,3cyclictest1105728-21kworker/u8:1+flush-259:022:20:003
94979899128,3cyclictest1069371-21kworker/u8:2+flush-259:021:20:303
94979899128,3cyclictest1059043-21kworker/u8:1+flush-259:021:15:293
94979899128,2cyclictest0-21swapper/320:20:013
94979499128,3cyclictest1188265-21kworker/u8:1+flush-259:023:00:292
94979499128,2cyclictest1007154-21systemd-run20:05:012
94979499126,5cyclictest335557-21systemd-journal00:25:002
94979499121,9cyclictest1100111-21awk21:35:002
94979099129,2cyclictest991585-21kworker/u8:2+events_unbound20:15:211
94979099129,2cyclictest1208929-21kworker/u8:0+events_unbound00:05:191
949788991211,1cyclictest60350irq/132-enp0s29f1:rx-019:45:150
94979899119,1cyclictest0-21swapper/323:00:003
94979899118,2cyclictest1162012-21unixbench_singl22:30:243
94979899113,6cyclictest335557-21systemd-journal00:07:253
94979899111,2cyclictest11079891kthreadcore21:40:203
94979499118,2cyclictest1085020-21cpuspeed_turbos21:20:162
94979499118,2cyclictest1069533-21cut21:05:142
94979499114,4cyclictest335557-21systemd-journal20:41:482
94978899119,1cyclictest60350irq/132-enp0s29f1:rx-020:35:170
94979499106,2cyclictest0-21swapper/220:45:192
9497989997,1cyclictest0-21swapper/319:35:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional