You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-30 - 13:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot3s.osadl.org (updated Tue Jun 30, 2026 00:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
121602236162,21sleep10-21swapper/119:05:561
123932232164,23sleep00-21swapper/019:08:570
121562224149,25sleep20-21swapper/219:05:532
122492202165,25sleep30-21swapper/319:07:063
125739910298,3cyclictest0-21swapper/221:39:082
12573998784,2cyclictest0-21swapper/220:33:562
112462560,7sleep230-21rcuc/222:45:132
179722520,1sleep30-21swapper/321:45:223
20092480,4sleep123-21ksoftirqd/123:35:251
187232480,1sleep00-21swapper/020:35:110
119492480,2sleep01256399cyclictest22:45:190
1257399411,31cyclictest0-21swapper/200:26:262
1257399411,30cyclictest0-21swapper/220:06:052
1257399410,29cyclictest0-21swapper/219:10:372
1257399401,28cyclictest0-21swapper/200:11:432
1257399391,29cyclictest0-21swapper/219:27:562
1257399350,22cyclictest0-21swapper/220:10:172
1257399341,30cyclictest0-21swapper/220:45:372
1257399341,27cyclictest0-21swapper/221:54:002
1257399341,22cyclictest0-21swapper/220:24:212
1257399341,22cyclictest0-21swapper/220:24:212
1257399341,21cyclictest0-21swapper/220:18:212
1257399341,21cyclictest0-21swapper/200:37:302
1257399341,20cyclictest0-21swapper/221:57:122
1256399343,15cyclictest1887-21munin-run22:25:010
1257399331,21cyclictest0-21swapper/219:41:522
1257399331,20cyclictest0-21swapper/223:57:032
1257399331,20cyclictest0-21swapper/200:04:552
1257899328,4cyclictest0-21swapper/320:16:283
1257899321,19cyclictest0-21swapper/319:13:213
12573993222,3cyclictest0-21swapper/222:51:272
1257399321,25cyclictest0-21swapper/200:09:472
1257399321,22cyclictest0-21swapper/220:36:332
1257399321,21cyclictest0-21swapper/200:34:462
1257399321,18cyclictest0-21swapper/223:20:592
1257399321,15cyclictest0-21swapper/223:31:232
1257399320,20cyclictest0-21swapper/220:53:212
1256399324,13cyclictest19828-21munin-run19:25:010
1256399322,22cyclictest20770-21kworker/0:222:07:150
1256399321,24cyclictest19740-21kworker/0:219:30:170
1256399321,23cyclictest18546-21kworker/0:021:51:250
1257899310,26cyclictest0-21swapper/320:36:113
1257399311,21cyclictest0-21swapper/221:06:252
1257399311,21cyclictest0-21swapper/221:01:492
1257399311,19cyclictest0-21swapper/219:50:482
1257399311,12cyclictest0-21swapper/219:38:122
1257399310,14cyclictest0-21swapper/223:28:352
1256399311,23cyclictest25615-21kworker/0:119:47:170
1256399311,23cyclictest12647-21kworker/0:222:58:190
1256399310,24cyclictest28245-21kworker/0:219:40:450
1256399310,24cyclictest25453-21kworker/0:019:11:390
1257399301,19cyclictest0-21swapper/219:23:322
1257399301,14cyclictest0-21swapper/219:49:282
1257399301,13cyclictest0-21swapper/223:38:352
1257399301,13cyclictest0-21swapper/222:38:422
1257399301,13cyclictest0-21swapper/222:19:542
1257399301,13cyclictest0-21swapper/221:41:562
1256399301,21cyclictest31082-21kworker/0:121:01:540
1256399301,20cyclictest9941-21kworker/0:221:31:490
1256399301,20cyclictest9941-21kworker/0:221:31:490
1256399301,12cyclictest3785-21kworker/0:022:35:190
266602290,4sleep21257399cyclictest22:05:192
1257399291,17cyclictest0-21swapper/222:42:032
1257399291,17cyclictest0-21swapper/222:42:032
1257399291,13cyclictest0-21swapper/223:41:432
1257399291,12cyclictest0-21swapper/223:52:352
1257399291,12cyclictest0-21swapper/223:00:112
1257399291,12cyclictest0-21swapper/221:16:132
1257399291,11cyclictest1252-21diskmemload00:24:422
1257399291,11cyclictest0-21swapper/219:56:482
1257399290,18cyclictest0-21swapper/200:18:422
1257399290,17cyclictest0-21swapper/222:28:022
1256399292,19cyclictest2450-21kworker/0:220:08:130
1256399291,20cyclictest2450-21kworker/0:220:01:530
1256399291,19cyclictest1002-21kworker/0:221:08:240
1257899281,6cyclictest0-21swapper/323:25:363
12573992817,3cyclictest0-21swapper/223:48:552
1257399281,13cyclictest0-21swapper/221:13:252
1257399281,12cyclictest0-21swapper/222:57:592
1257399281,12cyclictest0-21swapper/222:12:382
1257399281,12cyclictest0-21swapper/220:26:412
1257399281,11cyclictest0-21swapper/222:23:302
1257399281,11cyclictest0-21swapper/221:46:122
1257399281,11cyclictest0-21swapper/220:00:332
1257399281,10cyclictest0-21swapper/221:22:572
1257399281,10cyclictest0-21swapper/219:33:202
1256799281,16cyclictest827-21runrttasks20:11:171
1256399281,20cyclictest3198-21kworker/0:321:14:370
1256399281,15cyclictest3198-21kworker/0:321:15:370
1257899272,12cyclictest11196-21memory21:30:183
1257899272,12cyclictest11196-21memory21:30:183
1257899270,11cyclictest0-21swapper/300:37:453
1257399271,12cyclictest0-21swapper/223:18:192
1257399271,12cyclictest0-21swapper/222:03:522
1257399271,12cyclictest0-21swapper/221:34:452
1257399271,12cyclictest0-21swapper/221:34:452
1257399271,10cyclictest0-21swapper/220:40:412
1256799275,3cyclictest0-21swapper/122:28:011
1256799271,10cyclictest0-21swapper/122:15:031
1256399272,12cyclictest24844-21idleruntime-cro20:50:010
1256399271,19cyclictest8764-21kworker/0:123:57:110
1256399271,19cyclictest2214-21kworker/0:323:44:300
1256399271,19cyclictest14556-21kworker/0:200:25:030
1256399271,18cyclictest9941-21kworker/0:221:35:050
1256399270,19cyclictest7179-21kworker/0:020:13:570
1256399270,19cyclictest19406-21kworker/0:123:22:340
1256399270,19cyclictest12647-21kworker/0:223:06:030
1257899261,12cyclictest2113-21/usr/sbin/munin22:25:133
12578992610,4cyclictest12584-21ntp_states00:00:203
1257899260,9cyclictest0-21swapper/322:34:353
1257899260,9cyclictest0-21swapper/321:43:303
1257899260,19cyclictest0-21swapper/300:20:173
1257399261,15cyclictest8767-21hddtemp_smartct21:25:172
1257399261,15cyclictest0-21swapper/222:34:022
1257399261,13cyclictest0-21swapper/223:09:312
1257399261,12cyclictest0-21swapper/219:17:492
1257399261,11cyclictest0-21swapper/220:57:332
1256399262,14cyclictest18546-21kworker/0:021:48:370
1256399261,6cyclictest25615-21kworker/0:119:55:350
1256399261,18cyclictest8764-21kworker/0:123:51:390
1256399261,18cyclictest20210-21kworker/0:020:40:050
1256399261,14cyclictest9660-21kworker/0:120:23:370
1256399261,14cyclictest9660-21kworker/0:120:23:370
1256399260,19cyclictest3785-21kworker/0:022:44:270
1256399260,19cyclictest3785-21kworker/0:022:44:270
1257899255,15cyclictest7640-40dnf21:22:253
1257899251,9cyclictest0-21swapper/321:02:193
1257899251,4cyclictest0-21swapper/319:25:493
1257899250,10cyclictest0-21swapper/322:45:163
12573992518,3cyclictest0-21swapper/223:12:312
1256799252,12cyclictest22192-40dnf00:23:441
1256799251,7cyclictest0-21swapper/122:59:301
12567992513,10cyclictest6914-21kworker/u8:021:19:111
1256799251,17cyclictest0-21swapper/123:45:161
1256799251,11cyclictest18385-21sort20:35:021
12567992511,11cyclictest11157-21expr22:45:121
1256399256,3cyclictest23035-21kworker/0:121:57:430
1256399252,17cyclictest17610-21kworker/0:100:12:270
1256399252,16cyclictest14556-21kworker/0:200:24:430
1256399251,8cyclictest20770-21kworker/0:222:13:470
12563992512,2cyclictest27927-21kworker/0:223:25:420
1256399251,14cyclictest20233-21kworker/0:320:55:060
1256399251,11cyclictest25453-21kworker/0:019:19:480
1256399251,10cyclictest3198-21kworker/0:321:20:250
1256399250,14cyclictest20770-21kworker/0:222:28:030
1257899242,16cyclictest87350irq/126-enp1s0-21:51:503
1257899241,6cyclictest31916-21/usr/sbin/munin23:30:213
1257899241,12cyclictest0-21swapper/322:55:043
1257899241,11cyclictest4922-21/usr/sbin/munin23:45:163
1257899241,11cyclictest0-21swapper/323:07:113
1257899241,11cyclictest0-21swapper/300:34:323
1257899240,12cyclictest0-21swapper/323:15:533
1256799241,6cyclictest0-21swapper/122:04:181
12567992414,3cyclictest27759-21grep23:20:261
1256799240,18cyclictest21-21rcuc/122:45:021
1256799240,18cyclictest21-21rcuc/122:45:021
1256799240,18cyclictest0-21swapper/122:14:411
1256399241,8cyclictest25615-21kworker/0:119:50:130
1256399240,17cyclictest17178-21kworker/0:023:01:230
1257899238,3cyclictest6335-21ntp_states20:05:203
1257899233,3cyclictest140122tail21:35:263
1257899231,9cyclictest0-21swapper/320:52:213
1257899231,9cyclictest0-21swapper/320:27:543
1257899231,11cyclictest8701-21/usr/sbin/munin22:40:223
1257899231,11cyclictest8701-21/usr/sbin/munin22:40:223
1256799232,18cyclictest0-21swapper/121:55:031
1256799232,15cyclictest23-21ksoftirqd/119:20:211
1256799232,12cyclictest0-21swapper/121:54:301
1256799231,6cyclictest0-21swapper/121:45:331
1256799231,6cyclictest0-21swapper/121:36:351
1256799231,3cyclictest12181-21hddtemp_smartct00:00:131
1256799231,3cyclictest0-21swapper/119:35:011
1256799231,19cyclictest15717-21munin-run00:10:001
1256799231,16cyclictest0-21swapper/121:29:081
1256799231,16cyclictest0-21swapper/100:20:001
12567992310,11cyclictest1009-21kworker/u8:121:22:101
1256399231,9cyclictest19751-21kworker/0:300:31:430
1256399231,8cyclictest15772-21kworker/0:020:30:370
1256399231,6cyclictest0-21swapper/000:18:240
1256399231,16cyclictest19740-21kworker/0:219:27:330
1257899228,3cyclictest0-21swapper/322:06:293
1257899227,6cyclictest0-21swapper/319:19:253
1257899221,4cyclictest0-21swapper/322:04:173
1257899221,3cyclictest1252-21diskmemload21:26:193
1257899221,15cyclictest0-21swapper/323:36:113
1257899221,10cyclictest28832-21/usr/sbin/munin19:45:153
1257899221,10cyclictest0-21swapper/321:00:013
1256799222,14cyclictest0-21swapper/119:45:481
12567992214,3cyclictest0-21swapper/120:42:571
12567992213,5cyclictest0-21swapper/123:53:371
12567992212,3cyclictest10124-21irqstats23:55:151
1256799221,16cyclictest0-21swapper/123:12:191
1256799221,15cyclictest0-21swapper/120:04:481
1256799221,11cyclictest20307-21grep23:05:161
1256799220,5cyclictest21-21rcuc/122:20:201
1256399227,2cyclictest21983-21kworker/0:019:38:010
1256399222,11cyclictest5898-21kworker/0:023:48:150
1256399221,8cyclictest2214-21kworker/0:323:39:580
1256399221,8cyclictest12647-21kworker/0:222:52:150
1256399221,14cyclictest30070-21kworker/0:022:18:510
1256399221,11cyclictest32528-21kworker/0:123:34:220
1256399221,11cyclictest13464-21kworker/0:220:26:370
1257899216,8cyclictest0-21swapper/320:32:473
1257899215,3cyclictest0-21swapper/319:30:113
1257899215,2cyclictest87350irq/126-enp1s0-22:53:103
1257899213,3cyclictest0-21swapper/320:21:023
1257899213,3cyclictest0-21swapper/320:21:023
1257899211,3cyclictest0-21swapper/323:52:163
1257899211,3cyclictest0-21swapper/321:19:013
1257899211,3cyclictest0-21swapper/300:15:303
1257899211,11cyclictest9316-21/usr/sbin/munin23:55:233
1257899211,11cyclictest0-21swapper/323:10:203
1257899211,11cyclictest0-21swapper/322:23:593
12578992110,3cyclictest0-21swapper/323:04:163
1257899210,11cyclictest0-21swapper/319:50:473
1256799217,7cyclictest87550irq/128-enp1s0-23:40:151
1256799215,10cyclictest87550irq/128-enp1s0-00:31:581
1256799212,14cyclictest0-21swapper/123:17:441
1256799212,14cyclictest0-21swapper/119:51:451
1256799211,6cyclictest0-21swapper/122:53:481
1256799211,5cyclictest0-21swapper/121:43:351
1256799211,4cyclictest0-21swapper/100:29:041
12567992114,2cyclictest0-21swapper/120:54:311
12567992113,3cyclictest0-21swapper/120:25:441
1256799211,17cyclictest25156-21basename19:35:171
1256799211,15cyclictest0-21swapper/120:24:181
1256799211,15cyclictest0-21swapper/120:24:181
1256799211,15cyclictest0-21swapper/100:10:481
1256799211,14cyclictest0-21swapper/123:30:431
1256799211,14cyclictest0-21swapper/122:32:431
1256799211,14cyclictest0-21swapper/120:05:541
1256799211,14cyclictest0-21swapper/119:26:261
1256799211,11cyclictest10623-21df_inode21:30:121
1256799211,11cyclictest10623-21df_inode21:30:121
1256399215,2cyclictest21890-21kworker/0:023:18:120
1256399212,12cyclictest9941-21kworker/0:221:40:330
12563992115,3cyclictest827-21runrttasks22:00:230
1256399211,10cyclictest19751-21kworker/0:300:35:430
1256399210,4cyclictest6572-21kworker/u8:200:07:050
1257899208,3cyclictest31287-21processes22:15:233
1257899207,3cyclictest0-21swapper/322:36:393
1257899207,3cyclictest0-21swapper/319:23:253
1257899207,2cyclictest0-21swapper/319:56:453
1257899206,3cyclictest0-21swapper/321:57:573
1257899206,3cyclictest0-21swapper/300:26:153
1257899202,3cyclictest763-21dbus-daemon21:10:213
1257899201,7cyclictest0-21swapper/323:43:223
1257899201,16cyclictest28101-21grep19:40:263
1257899201,11cyclictest0-21swapper/320:14:243
1257899201,10cyclictest0-21swapper/320:00:483
1257899200,11cyclictest0-21swapper/322:14:413
1256799203,9cyclictest23-21ksoftirqd/120:50:011
12567992016,3cyclictest0-21swapper/122:37:071
12567992016,3cyclictest0-21swapper/121:13:071
1256799201,15cyclictest0-21swapper/119:58:071
1256799201,11cyclictest18566-21ntp_states23:00:211
1256799201,11cyclictest14887-21hddtemp_smartct19:15:021
1256799201,11cyclictest10929-21smart_sda20:15:221
1256799201,10cyclictest0-21swapper/100:35:131
1256799200,18cyclictest0-21swapper/120:57:231
1256799200,14cyclictest0-21swapper/122:08:421
1256799200,14cyclictest0-21swapper/121:00:461
1256799200,14cyclictest0-21swapper/120:38:551
1256399205,2cyclictest8764-21kworker/0:100:00:030
1256399202,11cyclictest19406-21kworker/0:123:11:180
1256399201,16cyclictest10062-21munin-run21:30:010
1257899196,3cyclictest0-21swapper/321:09:133
1257899196,3cyclictest0-21swapper/319:36:353
1257899194,3cyclictest0-21swapper/320:48:373
1257899191,6cyclictest0-21swapper/300:10:203
1257899191,5cyclictest21006-21df_inode20:40:143
12567991915,2cyclictest28494-21/usr/sbin/munin23:25:241
1256399199,2cyclictest7179-21kworker/0:020:17:170
1256399194,2cyclictest3785-21kworker/0:022:31:470
1256399192,6cyclictest22488-21kworker/0:120:52:560
1257899187,2cyclictest0-21swapper/300:05:153
1257899184,3cyclictest0-21swapper/323:24:473
12567991812,3cyclictest15023-21cut19:15:011
1256799171,13cyclictest32715-21ntp_states21:05:211
12567991710,4cyclictest27077-21tune2fs19:40:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional