You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-14 - 19:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Mon Sep 14, 2026 12:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
114188921250,3sleep30-21swapper/311:40:213
139099850,72rtkit-daemon0-21swapper/207:09:012
104480427535,13sleep10-21swapper/107:07:521
104349127444,21sleep30-21swapper/307:05:043
104366526543,14sleep00-21swapper/007:05:140
11346752530,3sleep03056-21PK-Backend11:20:160
10946382530,4sleep13056-21PK-Backend09:25:211
10766812510,3sleep23056-21PK-Backend08:35:182
104512999312,17cyclictest1103875-21date09:55:013
139099290,5rtkit-daemon2156-21gnome-shell11:31:090
10711192290,4sleep00-21swapper/008:20:120
104512999295,13cyclictest0-21swapper/311:33:183
139099270,3rtkit-daemon1389-21rtkit-daemon09:05:142
104512999276,10cyclictest1-21systemd11:29:363
104512999275,9cyclictest0-21swapper/308:19:183
104512999274,15cyclictest0-21swapper/308:36:093
104512999274,10cyclictest1074235-21date08:30:003
11133212260,4chrt0-21swapper/210:20:162
10527572260,16sleep013-21ksoftirqd/007:30:000
104512999263,14cyclictest0-21swapper/309:36:163
104512999261,16cyclictest0-21swapper/311:35:223
104512999254,8cyclictest1058252-21apt07:45:113
104512999254,13cyclictest0-21swapper/310:14:553
104512999253,9cyclictest1127452-21expr11:00:123
104512999253,6cyclictest1085927-21runrttasks09:01:173
104512999253,13cyclictest0-21swapper/310:55:533
104512999252,16cyclictest1788620-21WebKitWebProces09:15:113
10691322240,4chrt3056-21PK-Backend08:15:041
104512999246,7cyclictest1147948-21apt-get12:00:053
104512999245,17cyclictest42-21ksoftirqd/312:30:133
104512999243,13cyclictest0-21swapper/308:44:123
104512999242,6cyclictest1057989-21munin-run07:45:003
104512999241,9cyclictest1134036-21cat11:20:013
1045124992415,7cyclictest1153018-21users12:10:212
104512999238,12cyclictest1150575-21/usr/sbin/munin12:05:123
1045129992317,4cyclictest1068921-21sort08:15:013
104512999231,18cyclictest1082160-21python308:50:203
1045129992310,10cyclictest1143626-21python311:45:203
104512299235,6cyclictest141rcu_preempt09:04:080
1045122992318,4cyclictest13-21ksoftirqd/010:37:210
139099220,15rtkit-daemon3056-21PK-Backend12:18:121
139099220,14rtkit-daemon0-21swapper/111:26:321
11127622220,4chrt3056-21PK-Backend10:20:111
104512999223,14cyclictest1095-21runrttasks07:15:123
104512999223,10cyclictest0-21swapper/307:58:533
104512999222,12cyclictest0-21swapper/307:39:283
104512999221,8cyclictest1050984-21cron07:25:003
1045129992218,3cyclictest0-21swapper/309:13:183
1045129992215,4cyclictest1071764-21python308:20:203
1045129992210,10cyclictest1134805-21tr11:20:183
1045124992220,1cyclictest0-21swapper/212:38:202
1045124992220,1cyclictest0-21swapper/209:56:262
1045124992220,1cyclictest0-21swapper/208:06:002
1045124992219,2cyclictest0-21swapper/207:44:042
104512499220,21cyclictest0-21swapper/211:54:352
104512499220,20cyclictest1072367-21munin-run08:25:002
1045123992220,1cyclictest3056-21PK-Backend10:27:321
1045123992220,1cyclictest3056-21PK-Backend08:42:211
1045123992220,1cyclictest3056-21PK-Backend07:59:021
1045123992220,1cyclictest3056-21PK-Backend07:35:091
1045123992219,2cyclictest3056-21PK-Backend12:28:591
1045123992219,1cyclictest3056-21PK-Backend11:50:331
104512399220,20cyclictest3056-21PK-Backend09:46:431
104512399220,20cyclictest3056-21PK-Backend08:14:091
104512399220,20cyclictest3056-21PK-Backend08:05:241
104512399220,20cyclictest3056-21PK-Backend07:31:101
1045122992220,1cyclictest0-21swapper/012:36:470
1045122992220,1cyclictest0-21swapper/012:13:080
1045122992220,1cyclictest0-21swapper/011:55:310
1045122992220,1cyclictest0-21swapper/011:51:170
1045122992220,1cyclictest0-21swapper/011:13:260
104512299220,11cyclictest1087951-21cron09:09:590
139099210,14rtkit-daemon0-21swapper/010:16:590
104512999218,11cyclictest1118291-21sort10:35:143
104512999216,13cyclictest1111884-21python310:15:203
104512999215,13cyclictest1161307-21netstat12:35:183
1045129992119,1cyclictest0-21swapper/312:11:233
1045129992119,1cyclictest0-21swapper/310:54:583
1045129992119,1cyclictest0-21swapper/310:47:213
1045129992119,1cyclictest0-21swapper/310:43:563
1045129992119,1cyclictest0-21swapper/310:27:073
1045129992119,1cyclictest0-21swapper/310:24:303
1045129992119,1cyclictest0-21swapper/310:06:383
1045129992119,1cyclictest0-21swapper/309:41:103
1045129992119,1cyclictest0-21swapper/308:57:173
1045129992119,1cyclictest0-21swapper/308:46:283
1045129992119,1cyclictest0-21swapper/307:30:313
1045129992119,1cyclictest0-21swapper/307:28:553
1045129992114,5cyclictest1064817-21sshd08:00:373
1045129992111,8cyclictest1147350-21python311:55:203
104512999210,20cyclictest0-21swapper/311:14:253
104512999210,1cyclictest0-21swapper/309:25:083
104512999210,19cyclictest0-21swapper/310:30:313
1045124992119,1cyclictest0-21swapper/211:57:122
1045124992119,1cyclictest0-21swapper/211:21:292
1045124992119,1cyclictest0-21swapper/211:07:022
1045124992119,1cyclictest0-21swapper/210:49:112
1045124992119,1cyclictest0-21swapper/210:40:462
1045124992119,1cyclictest0-21swapper/210:30:322
1045124992119,1cyclictest0-21swapper/209:46:592
1045124992119,1cyclictest0-21swapper/209:13:062
1045124992119,1cyclictest0-21swapper/208:55:282
1045124992119,1cyclictest0-21swapper/208:46:152
1045124992119,1cyclictest0-21swapper/208:29:122
1045124992119,1cyclictest0-21swapper/207:49:522
1045124992114,5cyclictest1075216-21rt-features08:30:202
1045124992112,7cyclictest1135830-21apt11:25:112
104512499210,20cyclictest0-21swapper/212:33:082
104512499210,20cyclictest0-21swapper/209:29:562
1045123992119,1cyclictest3056-21PK-Backend12:09:461
1045123992119,1cyclictest3056-21PK-Backend11:46:201
1045123992119,1cyclictest3056-21PK-Backend11:41:191
1045123992119,1cyclictest3056-21PK-Backend11:30:321
1045123992119,1cyclictest3056-21PK-Backend11:09:441
1045123992119,1cyclictest3056-21PK-Backend07:16:431
1045123992119,1cyclictest0-21swapper/110:53:541
1045123992119,1cyclictest0-21swapper/108:38:561
1045123992119,1cyclictest0-21swapper/108:23:081
1045123992118,2cyclictest3056-21PK-Backend12:13:581
104512399210,20cyclictest3056-21PK-Backend11:04:431
104512399210,20cyclictest3056-21PK-Backend09:57:301
104512399210,20cyclictest3056-21PK-Backend08:54:311
104512399210,20cyclictest0-21swapper/110:07:311
104512399210,20cyclictest0-21swapper/109:40:551
104512399210,19cyclictest3056-21PK-Backend10:40:441
104512399210,19cyclictest3056-21PK-Backend09:16:071
104512399210,19cyclictest3056-21PK-Backend09:11:071
104512399210,19cyclictest3056-21PK-Backend08:00:371
1045122992119,1cyclictest0-21swapper/012:34:100
1045122992119,1cyclictest0-21swapper/012:20:440
1045122992119,1cyclictest0-21swapper/011:47:530
1045122992119,1cyclictest0-21swapper/011:08:260
1045122992119,1cyclictest0-21swapper/011:04:130
1045122992119,1cyclictest0-21swapper/009:53:430
1045122992119,1cyclictest0-21swapper/009:45:180
1045122992119,1cyclictest0-21swapper/009:36:530
1045122992119,1cyclictest0-21swapper/009:32:410
1045122992119,1cyclictest0-21swapper/009:27:410
1045122992119,1cyclictest0-21swapper/009:21:530
1045122992119,1cyclictest0-21swapper/009:13:280
1045122992119,1cyclictest0-21swapper/008:30:140
1045122992119,1cyclictest0-21swapper/007:21:550
1045122992119,1cyclictest0-21swapper/007:11:470
1045122992117,2cyclictest1140770-21idleruntime-cro11:40:000
104512299211,18cyclictest1091424-21apt-get09:20:000
104512299210,20cyclictest10738992sleep008:27:380
104512299210,20cyclictest0-21swapper/012:17:200
139099200,13rtkit-daemon3056-21PK-Backend10:50:400
11557852200,4sleep13056-21PK-Backend12:20:131
104512999202,12cyclictest1095430-21apt09:30:123
1045129992018,1cyclictest0-21swapper/312:21:363
1045129992018,1cyclictest0-21swapper/312:19:003
1045129992018,1cyclictest0-21swapper/309:48:473
1045129992018,1cyclictest0-21swapper/308:09:233
1045129992018,1cyclictest0-21swapper/307:11:383
104512999201,13cyclictest1128897-21apt11:05:123
104512999200,19cyclictest0-21swapper/311:50:073
104512999200,19cyclictest0-21swapper/309:20:083
1045124992018,1cyclictest0-21swapper/211:14:402
1045124992018,1cyclictest0-21swapper/210:55:132
1045124992018,1cyclictest0-21swapper/210:10:522
1045124992018,1cyclictest0-21swapper/207:31:062
1045124992018,1cyclictest0-21swapper/207:20:592
1045124992018,1cyclictest0-21swapper/207:19:232
104512499200,1cyclictest0-21swapper/212:23:412
104512499200,1cyclictest0-21swapper/209:40:102
104512499200,19cyclictest3056-21PK-Backend07:12:132
104512499200,19cyclictest0-21swapper/211:33:192
104512499200,19cyclictest0-21swapper/211:04:262
104512499200,19cyclictest0-21swapper/208:42:512
104512499200,19cyclictest0-21swapper/207:36:402
104512499200,19cyclictest0-21swapper/207:27:072
1045123992018,1cyclictest3056-21PK-Backend10:34:081
1045123992018,1cyclictest3056-21PK-Backend10:01:441
1045123992017,2cyclictest3056-21PK-Backend09:05:191
104512399200,1cyclictest3056-21PK-Backend09:53:181
104512399200,1cyclictest3056-21PK-Backend09:01:071
104512399200,19cyclictest3056-21PK-Backend07:51:181
104512399200,19cyclictest3056-21PK-Backend07:28:471
104512399200,18cyclictest3056-21PK-Backend10:59:431
104512299203,2cyclictest141rcu_preempt08:00:160
104512299202,4cyclictest13-21ksoftirqd/008:50:010
1045122992018,1cyclictest3056-21PK-Backend11:26:020
1045122992018,1cyclictest3056-21PK-Backend09:41:060
1045122992018,1cyclictest0-21swapper/012:09:430
1045122992018,1cyclictest0-21swapper/011:43:410
1045122992018,1cyclictest0-21swapper/011:16:510
1045122992018,1cyclictest0-21swapper/010:26:350
1045122992018,1cyclictest0-21swapper/009:57:560
1045122992018,1cyclictest0-21swapper/008:58:270
1045122992018,1cyclictest0-21swapper/008:52:390
1045122992018,1cyclictest0-21swapper/007:52:090
1045122992018,1cyclictest0-21swapper/007:43:580
104512299200,6cyclictest1123165-21sh10:50:000
104512299200,1cyclictest0-21swapper/010:31:190
104512299200,1cyclictest0-21swapper/010:02:550
104512299200,19cyclictest3056-21PK-Backend08:11:160
104512299200,19cyclictest0-21swapper/012:00:310
104512299200,19cyclictest0-21swapper/010:23:580
104512299200,19cyclictest0-21swapper/010:10:330
139099190,15rtkit-daemon1045114-21cyclictest08:30:143
10811272190,4sleep13056-21PK-Backend08:50:011
104512999191,6cyclictest0-21swapper/307:50:143
1045129991912,5cyclictest1157535-21cat12:25:143
1045129991912,3cyclictest1086502-21apt09:05:123
104512499193,4cyclictest34-21ksoftirqd/208:19:182
1045124991917,1cyclictest0-21swapper/209:35:572
1045124991917,1cyclictest0-21swapper/209:24:562
1045124991917,1cyclictest0-21swapper/208:51:162
1045124991917,1cyclictest0-21swapper/208:14:592
1045124991913,4cyclictest1-21systemd07:55:012
1045124991912,6cyclictest1132901-21sed11:15:182
1045124991912,5cyclictest28650irq/123-ahci[0009:30:212
104512499190,1cyclictest0-21swapper/209:50:242
104512499190,18cyclictest0-21swapper/212:17:212
104512499190,18cyclictest0-21swapper/210:27:562
1045123991917,1cyclictest3056-21PK-Backend12:33:121
1045123991917,1cyclictest3056-21PK-Backend10:45:441
1045123991917,1cyclictest3056-21PK-Backend09:20:201
1045123991917,1cyclictest3056-21PK-Backend08:34:441
1045123991917,1cyclictest3056-21PK-Backend08:29:441
1045123991916,2cyclictest3056-21PK-Backend10:39:561
1045123991916,2cyclictest3056-21PK-Backend07:14:201
104512399190,1cyclictest3056-21PK-Backend12:38:121
104512399190,1cyclictest3056-21PK-Backend11:37:081
104512399190,1cyclictest3056-21PK-Backend10:19:071
104512399190,18cyclictest0-21swapper/110:13:191
104512299195,2cyclictest141rcu_preempt07:55:030
1045122991917,1cyclictest0-21swapper/010:05:330
1045122991911,2cyclictest13-21ksoftirqd/008:45:000
104512299190,1cyclictest0-21swapper/007:17:220
139099180,15rtkit-daemon1009-21lldpd09:04:302
104512999189,7cyclictest1104543-21cat09:55:173
1045129991816,1cyclictest0-21swapper/310:03:143
1045124991816,1cyclictest3056-21PK-Backend10:07:272
1045124991816,1cyclictest0-21swapper/211:42:452
1045124991816,1cyclictest0-21swapper/211:35:072
1045124991812,5cyclictest1158369-21seq12:27:022
1045124991811,5cyclictest436-20systemd-journal10:50:312
1045124991810,6cyclictest34-21ksoftirqd/208:00:162
104512499180,1cyclictest0-21swapper/209:17:392
1045123991815,2cyclictest3056-21PK-Backend07:43:061
104512399181,15cyclictest1131606-21grep11:10:211
104512299183,3cyclictest141rcu_preempt10:40:040
1045122991816,1cyclictest0-21swapper/012:29:580
104512299181,4cyclictest13-21ksoftirqd/007:37:190
1045122991812,4cyclictest1053612-21grep07:30:150
1045122991811,5cyclictest1076104-21seq08:35:120
104512499179,6cyclictest1112029-21wc10:15:202
1045124991715,1cyclictest0-21swapper/212:06:372
1045124991715,1cyclictest0-21swapper/211:46:102
1045124991713,3cyclictest34-21ksoftirqd/208:00:002
1045124991711,5cyclictest1106563-21uname10:00:172
1045124991711,4cyclictest1118904-21cut10:35:202
1045123991715,1cyclictest3056-21PK-Backend12:04:461
104512299174,2cyclictest141rcu_preempt08:07:380
1045122991713,2cyclictest13-21ksoftirqd/008:15:140
1045123991614,1cyclictest3056-21PK-Backend07:23:261
104512399160,1cyclictest3056-21PK-Backend11:15:311
1045122991612,2cyclictest13-21ksoftirqd/010:56:080
1045122991612,2cyclictest13-21ksoftirqd/007:45:560
104512499157,6cyclictest1149243-21awk12:00:192
104512399158,5cyclictest1058963-21ntp_kernel_pll_07:45:181
1045123991513,1cyclictest3056-21PK-Backend09:34:191
1045123991510,4cyclictest3056-21PK-Backend11:57:471
10837772140,4chrt3056-21PK-Backend08:55:171
104512399143,3cyclictest141rcu_preempt09:40:001
1045123991310,2cyclictest1134072-21/usr/sbin/munin11:20:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional