You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-07 - 23:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Sun Dec 07, 2025 12:39:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4171819996550,9cyclictest1-21systemd10:45:022
4171818995940,15cyclictest1-21systemd09:40:031
417181899593,34cyclictest136172-21ssh12:04:241
4171817995736,17cyclictest0-21swapper/007:54:270
4171817995634,19cyclictest3339547-21cups-browsed08:45:010
4171817995527,25cyclictest0-21swapper/012:24:110
4171817995527,25cyclictest0-21swapper/012:24:110
4171817995447,5cyclictest4171816-21cyclictest12:00:010
4171817995337,12cyclictest118485-21latency_hist11:40:020
4171818995218,18cyclictest0-21swapper/109:30:011
4171818995218,18cyclictest0-21swapper/109:30:011
4171817995227,4cyclictest62741-21idleruntime-cro10:20:010
417181799513,40cyclictest121084-21ssh11:44:210
4171817995129,19cyclictest96705-21proc_pri11:09:300
4171817995129,19cyclictest96705-21proc_pri11:09:300
4171818994942,4cyclictest151984-21cron12:25:001
4171818994942,4cyclictest151984-21cron12:25:001
4171817994924,6cyclictest93911-21sh11:05:010
4171817994825,4cyclictest959-21mta-sts-daemon08:39:420
4171817994825,4cyclictest959-21mta-sts-daemon08:39:420
4171817994816,26cyclictest16770-21ssh09:14:260
4171818994738,5cyclictest133354-21sendmail12:00:011
4171818994721,23cyclictest1793-21head08:29:361
4171817994724,3cyclictest0-21swapper/010:55:010
4171817994724,3cyclictest0-21swapper/010:55:010
4171817994720,6cyclictest0-21swapper/010:50:040
4171819994634,7cyclictest0-21swapper/212:14:262
4171818994637,6cyclictest59347-21latency_hist10:15:021
4171818994637,5cyclictest114030-21ssh11:34:241
4171818994637,5cyclictest114030-21ssh11:34:241
4171818994626,17cyclictest107268-21ntp_states11:24:281
4171819994536,5cyclictest4174837-21systemd-run07:20:012
4171819994535,7cyclictest31300-21sh09:35:042
417181899452,31cyclictest955-21mta-sts-daemon09:15:161
417181899451,12cyclictest4172780-21ntpq07:14:241
4171819994434,8cyclictest82310-21sshd10:49:112
4171819994434,8cyclictest82310-21sshd10:49:112
4171818994436,5cyclictest45010-21munin-plugin-st09:55:011
4171818994435,5cyclictest14154-21unixbench_multi09:10:211
4171818994325,14cyclictest48564-21sendmail-msp10:00:011
417181899432,34cyclictest4177237-21ntpq07:29:231
417181899432,34cyclictest4177237-21ntpq07:29:231
4171818994322,18cyclictest6344-21cut08:45:001
417181899431,4cyclictest96611-21ntpq11:09:261
417181899431,4cyclictest96611-21ntpq11:09:261
417181899431,13cyclictest128614-21ssh11:54:231
4171819994233,6cyclictest421-21avahi-daemon11:44:162
4171819994230,7cyclictest3339547-21cups-browsed10:23:472
4171818994235,4cyclictest31281-21cron09:35:001
4171818994234,5cyclictest156049-21cron12:30:001
4171818994234,5cyclictest156049-21cron12:30:001
4171818994232,6cyclictest4862-21systemd-run08:40:011
4171818994232,6cyclictest4862-21systemd-run08:40:011
417181899421,4cyclictest79338-21ntpq10:44:201
417181899421,13cyclictest36986-21diskstats09:44:111
417181899421,10cyclictest100243-21ntpq11:14:341
417181899421,10cyclictest100243-21ntpq11:14:341
417181899420,11cyclictest4175043-21sshd07:20:121
4171819994133,5cyclictest422-21dbus-daemon10:15:012
4171819994132,6cyclictest12356-21systemd-run09:05:012
4171819994130,7cyclictest3339547-21cups-browsed10:31:492
4171819994129,7cyclictest3339547-21cups-browsed11:45:112
417181899413,27cyclictest147391-21ssh12:19:221
417181899411,9cyclictest4179887-21/usr/sbin/munin07:39:151
417181899411,5cyclictest54857-21ntpq10:09:271
417181899411,5cyclictest4183211-21ntpq07:49:201
417181899411,10cyclictest88202-21ssh10:57:131
4171818994110,29cyclictest71680-21ssh10:33:531
4171818994110,28cyclictest271ktimers/109:04:221
4171817994134,5cyclictest140806-21systemd-run12:10:010
4171817994133,5cyclictest151ktimers/009:04:210
4171817994132,6cyclictest27831-21unin-run09:30:010
4171817994132,6cyclictest27831-21unin-run09:30:010
4171819994032,5cyclictest39914-21aten_r2power_cu09:49:122
4171819994029,7cyclictest421-21avahi-daemon11:38:482
4171819994025,9cyclictest12865-21diskmemload09:44:222
417181999402,32cyclictest151334-21ssh12:24:262
417181999402,32cyclictest151334-21ssh12:24:262
417181999402,30cyclictest13627-21ssh09:10:122
417181899408,29cyclictest22397-21ssh09:22:501
417181899408,29cyclictest22397-21ssh09:22:501
417181899402,5cyclictest65542-21ntpq10:24:231
417181899402,5cyclictest2818-21ntpq08:34:231
417181899402,5cyclictest2818-21ntpq08:34:231
4171818994019,18cyclictest959-21mta-sts-daemon11:17:481
4171818994019,18cyclictest959-21mta-sts-daemon11:17:481
417181899401,5cyclictest8699-21ntpq08:54:201
417181899401,5cyclictest4178676-21ntpq07:34:291
417181899401,4cyclictest121093-21ntpq11:44:221
417181899401,13cyclictest159331-21ntpq12:34:281
417181899401,13cyclictest159331-21ntpq12:34:281
417181899401,10cyclictest66963-21ssh10:26:071
417181899401,10cyclictest38786-21ssh09:45:411
4171817994030,7cyclictest106766-21fschecks_count11:24:140
4171819993930,6cyclictest34427-21unixbench-2d09:39:342
4171818993931,5cyclictest1-21systemd11:50:011
417181899392,5cyclictest139942-21ntpq12:09:231
417181899392,4cyclictest4181709-21ntpq07:44:201
417181899391,9cyclictest81703-21ssh10:48:041
417181899391,9cyclictest81703-21ssh10:48:041
417181899391,9cyclictest4193331-21diskstats08:24:171
417181899391,9cyclictest4189055-21memory08:09:161
417181899391,9cyclictest117614-21ntpq11:39:301
4171818993916,17cyclictest0-21swapper/111:30:021
417181899391,5cyclictest4190786-21ntpq08:14:261
417181899391,4cyclictest4192181-21ntpq08:19:201
417181899391,3cyclictest4187715-21ntpq08:04:221
417181899391,3cyclictest10203-21ntpq08:59:191
417181899391,12cyclictest91339-21ssh11:01:251
417181899391,11cyclictest49146-21ssh10:00:571
417181899391,11cyclictest161772-21ssh12:37:441
417181899390,4cyclictest62002-21ntpq10:19:261
4171817993934,2cyclictest0-21swapper/010:00:010
4171819993832,3cyclictest0-21swapper/210:20:012
4171819993828,5cyclictest76796-21idleruntime-cro10:40:012
417181899382,5cyclictest4184674-21ntpq07:54:271
417181899381,9cyclictest84076-21ssh10:50:161
417181899381,9cyclictest84076-21ssh10:50:161
417181899381,5cyclictest7210-21ntpq08:49:201
417181899381,10cyclictest74299-21ssh10:36:451
417181899381,10cyclictest141035-21ssh12:10:041
417181899381,10cyclictest108786-21ssh11:26:321
4171817993832,3cyclictest0-21swapper/012:29:110
4171817993832,3cyclictest0-21swapper/012:29:110
4171817993824,8cyclictest12450irq/32-eth009:39:280
4171817993818,13cyclictest12450irq/32-eth012:39:250
417181999371,26cyclictest93013-21sh11:04:212
417181899371,4cyclictest4186168-21ntpq07:59:201
417181899371,11cyclictest4174199-21ntpq07:19:221
417181799373,27cyclictest75896-21ssh10:39:210
4171817993728,6cyclictest3339523-21cupsd10:31:160
4171819993629,3cyclictest0-21swapper/209:10:032
4171819993628,4cyclictest0-21swapper/210:29:392
4171819993626,5cyclictest155062-21/usr/sbin/munin12:29:202
4171819993626,5cyclictest155062-21/usr/sbin/munin12:29:202
4171818993627,5cyclictest12889-21systemd-run09:10:011
417181799364,25cyclictest159350-21sh12:34:290
417181799364,25cyclictest159350-21sh12:34:290
4171817993631,3cyclictest110208-21gltestperf11:29:180
4171817993631,3cyclictest110208-21gltestperf11:29:180
4171817993629,4cyclictest90546-21latency_hist11:00:020
4171817993629,4cyclictest4173289-21cron07:15:010
4171817993629,3cyclictest0-21swapper/009:24:160
4171817993629,3cyclictest0-21swapper/009:24:160
4171817993626,7cyclictest45006-21ssh09:55:010
4171817993623,10cyclictest0-21swapper/007:20:010
4171817993615,16cyclictest12450irq/32-eth010:29:280
4171819993529,3cyclictest0-21swapper/212:05:012
4171819993528,5cyclictest0-21swapper/208:10:012
4171819993527,5cyclictest44730-21unixbench_multi09:54:342
4171819993527,5cyclictest4192801-21munin-plugin-st08:20:012
4171819993524,7cyclictest87062-21idleruntime-cro10:55:012
4171819993524,7cyclictest87062-21idleruntime-cro10:55:012
4171819993519,9cyclictest0-21swapper/208:59:222
417181899351,4cyclictest4171829-21munin-run07:10:021
4171817993529,4cyclictest957-21mta-sts-daemon08:54:210
4171817993528,5cyclictest12450irq/32-eth011:14:300
4171817993528,5cyclictest12450irq/32-eth011:14:300
4171817993527,5cyclictest3339547-21cups-browsed10:40:500
4171817993526,7cyclictest4186149-21ntp_kernel_err07:59:200
4171817993526,6cyclictest3339547-21cups-browsed09:42:250
4171817993525,7cyclictest3339523-21cupsd09:34:370
4171817993524,8cyclictest0-21swapper/012:19:340
4171817993518,5cyclictest114441-21timerandwakeup11:34:360
4171817993518,5cyclictest114441-21timerandwakeup11:34:360
4171819993429,2cyclictest0-21swapper/209:20:012
4171819993427,4cyclictest49171-21ssh10:01:012
4171819993427,4cyclictest0-21swapper/212:19:212
4171819993424,4cyclictest955-21mta-sts-daemon11:14:332
4171819993424,4cyclictest955-21mta-sts-daemon11:14:332
4171819993423,7cyclictest114401-21threads11:34:352
4171819993423,7cyclictest114401-21threads11:34:352
4171819993324,6cyclictest0-21swapper/211:20:022
4171819993324,6cyclictest0-21swapper/211:20:022
4171817993326,4cyclictest4188708-21/usr/sbin/munin08:09:110
4171819993225,4cyclictest129519-21debian-sa111:55:012
4171819993225,4cyclictest110537-21ntp_kernel_err11:29:232
4171819993225,4cyclictest110537-21ntp_kernel_err11:29:232
4171819993225,3cyclictest0-21swapper/210:59:232
4171819993224,5cyclictest161488-21ssh12:37:122
4171819993222,7cyclictest106613-21sshd11:24:112
4171819993221,7cyclictest159098-21missed_timers12:34:212
4171819993221,7cyclictest159098-21missed_timers12:34:212
4171817993227,3cyclictest959-21mta-sts-daemon10:09:240
4171817993226,4cyclictest4193165-21aten_r2power_fr08:24:150
4171817993225,4cyclictest58531-21mailstats10:14:280
4171817993225,4cyclictest4180793-21munin-plugin-st07:40:000
4171817993225,4cyclictest12865-21diskmemload10:25:030
4171817993225,4cyclictest1-21systemd09:10:020
4171817993223,7cyclictest135393-21/usr/sbin/munin12:04:170
4171817993223,6cyclictest3339547-21cups-browsed11:51:480
4171817993223,5cyclictest12450irq/32-eth010:04:270
4171819993125,3cyclictest0-21swapper/211:09:242
4171819993125,3cyclictest0-21swapper/211:09:242
4171819993124,3cyclictest0-21swapper/209:29:252
4171819993124,3cyclictest0-21swapper/209:29:252
4171819993123,5cyclictest48577-21systemd-run10:00:012
4171819993122,6cyclictest4194303-21cron08:25:012
4171817993122,6cyclictest12450irq/32-eth009:49:260
4171817993112,13cyclictest657-21snmpd11:17:030
4171817993112,13cyclictest657-21snmpd11:17:030
4171819993022,5cyclictest6290-21grep08:44:442
4171819993022,5cyclictest4879-21latency_hist08:40:012
4171819993022,5cyclictest4879-21latency_hist08:40:012
4171819993022,5cyclictest4185189-21unixbench_multi07:54:392
4171819993022,3cyclictest0-21swapper/209:24:202
4171819993022,3cyclictest0-21swapper/209:24:202
4171819993021,7cyclictest4173066-21timerandwakeup07:14:312
4171817993023,3cyclictest0-21swapper/010:49:190
417181799302,24cyclictest20138-21ssh09:19:220
4171817993012,13cyclictest0-21swapper/007:45:030
4171819992923,4cyclictest4171816-21cyclictest10:09:242
4171819992922,4cyclictest959-21mta-sts-daemon12:05:452
4171819992922,2cyclictest0-21swapper/207:29:222
4171819992922,2cyclictest0-21swapper/207:29:222
4171819992921,5cyclictest3322-21cron08:35:012
4171819992921,5cyclictest3322-21cron08:35:012
4171819992920,5cyclictest4179127-21timerwakeupswit07:34:402
4171819992919,8cyclictest132348-21ssh11:59:182
4171817992922,3cyclictest0-21swapper/009:00:010
4171817992921,4cyclictest12550irq/33-eth008:14:250
4171819992818,7cyclictest9315-21cron08:55:012
417181799282,21cyclictest143690-21sh12:14:210
4171817992821,4cyclictest4188301-21latency_hist08:05:010
417181999276,14cyclictest437-21mta-sts-daemon08:49:272
4171819992719,5cyclictest4191023-21find08:14:312
4171819992716,8cyclictest4175677-21ntp_kernel_err07:24:202
4171819992713,9cyclictest351ktimers/208:29:272
4171817992723,2cyclictest12550irq/33-eth007:34:300
4171817992721,4cyclictest7801-21unixbench_singl08:49:330
4171817992720,4cyclictest124312-21aten2.4-expect11:49:120
4171817992719,6cyclictest4182849-21fschecks_time07:49:130
4171819992620,3cyclictest0-21swapper/208:00:012
4171819992620,3cyclictest0-21swapper/207:40:002
417181799262,19cyclictest4175735-21sshd07:24:220
4171819992518,4cyclictest4187195-21aten2.4-expect08:04:112
4171819992516,7cyclictest4183599-21timerwakeupswit07:49:312
4171819992417,5cyclictest4182498-21latency_hist07:45:032
4171817992419,3cyclictest4177796-21cron07:30:010
4171817992419,3cyclictest4177796-21cron07:30:010
4171817992412,2cyclictest0-21swapper/008:29:330
4171817992318,3cyclictest0-21swapper/008:20:010
4171819992216,3cyclictest0-21swapper/207:10:012
4171817992215,5cyclictest3325-21cron08:35:010
4171817992215,5cyclictest3325-21cron08:35:010
417181799179,2cyclictest0-21swapper/007:10:020
417182099168,5cyclictest431ktimers/307:10:013
417182099161,7cyclictest0-21swapper/310:09:283
417182099152,8cyclictest0-21swapper/310:59:273
417182099151,8cyclictest0-21swapper/312:29:223
417182099151,8cyclictest0-21swapper/312:29:223
417182099151,7cyclictest0-21swapper/309:19:193
417182099142,7cyclictest0-21swapper/312:09:213
417182099142,7cyclictest0-21swapper/311:24:283
417182099142,7cyclictest0-21swapper/309:34:283
417182099142,6cyclictest0-21swapper/312:24:203
417182099142,6cyclictest0-21swapper/312:24:203
417182099142,6cyclictest0-21swapper/311:49:203
417182099142,6cyclictest0-21swapper/310:44:223
417182099142,6cyclictest0-21swapper/310:39:273
417182099141,7cyclictest0-21swapper/310:14:213
417182099141,7cyclictest0-21swapper/309:54:213
417182099141,7cyclictest0-21swapper/309:28:123
417182099141,7cyclictest0-21swapper/309:28:123
417182099141,6cyclictest0-21swapper/310:49:113
417182099141,6cyclictest0-21swapper/310:49:113
417182099141,6cyclictest0-21swapper/309:04:243
417182099141,6cyclictest0-21swapper/308:04:243
417182099141,6cyclictest0-21swapper/307:49:203
417182099141,6cyclictest0-21swapper/307:29:223
417182099141,6cyclictest0-21swapper/307:29:223
417182099133,6cyclictest0-21swapper/309:10:023
417182099133,5cyclictest0-21swapper/309:44:083
417182099132,7cyclictest0-21swapper/310:30:013
417182099132,6cyclictest0-21swapper/311:19:213
417182099132,6cyclictest0-21swapper/311:19:213
417182099132,6cyclictest0-21swapper/310:24:223
417182099132,6cyclictest0-21swapper/308:19:213
417182099131,8cyclictest0-21swapper/312:14:183
417182099131,7cyclictest0-21swapper/312:39:193
417182099131,7cyclictest0-21swapper/312:19:243
417182099131,7cyclictest0-21swapper/311:44:213
417182099131,7cyclictest0-21swapper/309:10:043
417182099131,7cyclictest0-21swapper/308:29:253
417182099131,6cyclictest0-21swapper/309:24:123
417182099131,6cyclictest0-21swapper/309:24:123
417182099131,6cyclictest0-21swapper/308:54:213
417182099131,6cyclictest0-21swapper/308:34:183
417182099131,6cyclictest0-21swapper/308:34:183
417182099131,6cyclictest0-21swapper/307:59:223
417182099126,4cyclictest0-21swapper/310:20:013
417182099126,4cyclictest0-21swapper/310:04:133
417182099126,4cyclictest0-21swapper/309:00:013
417182099124,6cyclictest0-21swapper/310:54:263
417182099124,6cyclictest0-21swapper/310:54:263
417182099123,5cyclictest0-21swapper/311:29:273
417182099123,5cyclictest0-21swapper/311:29:273
417182099123,5cyclictest0-21swapper/311:04:303
417182099122,7cyclictest0-21swapper/311:34:173
417182099122,7cyclictest0-21swapper/311:34:173
417182099122,6cyclictest0-21swapper/312:34:103
417182099122,6cyclictest0-21swapper/312:34:103
417182099122,6cyclictest0-21swapper/311:59:113
417182099122,6cyclictest0-21swapper/310:34:313
417182099122,6cyclictest0-21swapper/308:14:113
417182099122,5cyclictest0-21swapper/309:59:183
417182099122,5cyclictest0-21swapper/309:49:253
417182099122,5cyclictest0-21swapper/307:55:013
417182099121,7cyclictest0-21swapper/311:54:143
417182099121,7cyclictest0-21swapper/311:14:303
417182099121,7cyclictest0-21swapper/311:14:303
417182099121,6cyclictest0-21swapper/312:02:123
417182099121,6cyclictest0-21swapper/311:09:243
417182099121,6cyclictest0-21swapper/311:09:243
417182099121,6cyclictest0-21swapper/308:09:193
417182099120,6cyclictest0-21swapper/308:24:233
417182099113,4cyclictest0-21swapper/308:40:013
417182099113,4cyclictest0-21swapper/308:40:013
417182099112,6cyclictest0-21swapper/307:24:223
417182099112,5cyclictest0-21swapper/311:39:113
417182099112,5cyclictest0-21swapper/307:20:013
417182099111,7cyclictest0-21swapper/309:39:183
417182099111,5cyclictest0-21swapper/307:34:243
417182099111,5cyclictest0-21swapper/307:14:203
417182099110,6cyclictest0-21swapper/307:39:213
41718209994,3cyclictest0-21swapper/308:44:183
41718209991,6cyclictest0-21swapper/308:49:103
41718209991,5cyclictest0-21swapper/307:44:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional