You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-01 - 10:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat Aug 01, 2026 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
941299250,24cyclictest3466-21diskmemload00:30:153
941299250,24cyclictest24324-21rm22:26:393
941299250,24cyclictest2197-21cron20:00:013
9407992523,1cyclictest0-21swapper/222:20:442
9407992520,4cyclictest0-21swapper/221:30:342
940699250,24cyclictest0-21swapper/100:08:111
940699250,1cyclictest9850-21ssh22:43:191
940699250,1cyclictest0-21swapper/122:55:011
940699250,0cyclictest0-21swapper/121:11:451
940599250,24cyclictest3466-21diskmemload21:17:300
940599250,24cyclictest3466-21diskmemload00:32:510
940599250,24cyclictest0-21swapper/022:54:350
940599250,0cyclictest0-21swapper/019:48:360
941299240,2cyclictest4005-21ssh21:10:223
941299240,23cyclictest3466-21diskmemload22:23:213
941299240,23cyclictest3466-21diskmemload00:25:273
941299240,23cyclictest22059-21sh21:27:003
941299240,23cyclictest0-21swapper/323:10:563
941299240,0cyclictest3466-21diskmemload22:09:453
9407992424,0cyclictest281ksoftirqd/200:16:002
9407992423,0cyclictest25763-21apt-get22:28:352
940799240,23cyclictest0-21swapper/223:23:572
940799240,23cyclictest0-21swapper/222:43:372
940799240,23cyclictest0-21swapper/200:20:592
940799240,1cyclictest0-21swapper/222:49:022
9406992422,1cyclictest21831-21idleruntime-cro19:35:001
940699240,24cyclictest0-21swapper/100:17:561
940699240,23cyclictest3466-21diskmemload21:24:551
940699240,23cyclictest3466-21diskmemload21:24:551
940699240,23cyclictest0-21swapper/123:31:531
940699240,23cyclictest0-21swapper/121:40:411
940699240,23cyclictest0-21swapper/100:21:181
940699240,0cyclictest0-21swapper/122:33:171
940699240,0cyclictest0-21swapper/121:53:541
9405992423,1cyclictest62550irq/127-eno121:12:240
9405992423,0cyclictest3466-21diskmemload22:40:310
940599240,24cyclictest0-21swapper/021:34:150
940599240,23cyclictest3466-21diskmemload21:21:390
940599240,23cyclictest3466-21diskmemload21:21:390
940599240,23cyclictest25180-21ssh22:27:530
940599240,23cyclictest0-21swapper/023:36:330
940599240,23cyclictest0-21swapper/023:24:130
940599240,0cyclictest0-21swapper/023:30:030
940599240,0cyclictest0-21swapper/021:44:060
940599240,0cyclictest0-21swapper/000:23:570
9412992323,0cyclictest3466-21diskmemload21:24:443
9412992323,0cyclictest3466-21diskmemload21:24:443
9412992323,0cyclictest0-21swapper/322:45:173
9412992323,0cyclictest0-21swapper/300:10:223
9412992321,1cyclictest7648-21rm00:07:023
9412992321,1cyclictest0-21swapper/321:58:423
941299230,23cyclictest0-21swapper/322:37:423
941299230,22cyclictest9536-21ssh21:44:033
941299230,22cyclictest9364-21ssh23:39:133
941299230,22cyclictest6515-21sh00:36:283
941299230,22cyclictest31993-21ssh23:30:443
941299230,22cyclictest29842-21sh22:31:313
941299230,22cyclictest20492-21sh23:21:183
941299230,22cyclictest18403-21ssh21:53:123
941299230,22cyclictest0-21swapper/323:16:473
941299230,22cyclictest0-21swapper/321:32:123
941299230,0cyclictest0-21swapper/300:02:163
9407992323,0cyclictest3466-21diskmemload23:18:272
9407992323,0cyclictest3466-21diskmemload22:06:462
9407992323,0cyclictest0-21swapper/200:32:022
9407992322,1cyclictest3466-21diskmemload00:27:242
9407992322,1cyclictest12603-21ssh22:15:512
9407992322,0cyclictest7459-21apt-get21:43:372
9407992321,1cyclictest0-21swapper/223:10:532
9407992321,1cyclictest0-21swapper/222:03:032
9407992321,1cyclictest0-21swapper/221:35:282
9407992320,2cyclictest6636-21ssh00:05:452
9407992320,2cyclictest29632-21ssh22:31:142
9407992320,2cyclictest17890-21rm23:47:482
9407992320,2cyclictest12121-21ssh21:47:162
940799230,23cyclictest0-21swapper/223:35:062
940799230,23cyclictest0-21swapper/223:30:102
940799230,23cyclictest0-21swapper/223:26:112
940799230,23cyclictest0-21swapper/222:50:132
940799230,22cyclictest6666-21sh22:10:172
940799230,22cyclictest606-21dbus-daemon20:15:002
940799230,22cyclictest3466-21diskmemload22:35:292
940799230,22cyclictest31827-21sh19:55:012
940799230,22cyclictest0-21swapper/200:01:022
940799230,0cyclictest3466-21diskmemload23:53:012
940799230,0cyclictest151rcu_preempt21:11:362
940799230,0cyclictest0-21swapper/221:26:262
9406992323,0cyclictest3466-21diskmemload22:01:121
9406992323,0cyclictest0-21swapper/123:45:231
9406992323,0cyclictest0-21swapper/122:07:261
9406992321,2cyclictest3466-21diskmemload22:46:541
9406992321,1cyclictest19622-21apt-get20:38:361
9406992321,1cyclictest0-21swapper/123:53:081
9406992321,1cyclictest0-21swapper/122:10:131
9406992321,1cyclictest0-21swapper/121:46:051
9406992320,2cyclictest7938-21sh23:09:411
9406992320,2cyclictest11736-21sh23:42:071
940699230,2cyclictest8024-21ssh00:38:341
940699230,23cyclictest3466-21diskmemload00:02:511
940699230,23cyclictest0-21swapper/121:58:351
940699230,23cyclictest0-21swapper/100:10:541
940699230,22cyclictest659-21ssh00:31:061
940699230,22cyclictest3466-21diskmemload22:16:191
940699230,22cyclictest32762-21apt-get19:58:351
940699230,22cyclictest32319-21ssh21:35:471
940699230,22cyclictest21444-21sh23:22:411
940699230,22cyclictest0-21swapper/121:30:361
940699230,1cyclictest11848-21latency_hist20:20:001
9405992323,0cyclictest0-21swapper/021:45:300
9405992323,0cyclictest0-21swapper/021:35:450
9405992321,1cyclictest62550irq/127-eno123:17:130
9405992321,1cyclictest31265-21rm22:33:280
9405992321,1cyclictest26288-21cron20:50:010
9405992321,1cyclictest0-21swapper/023:10:220
9405992321,1cyclictest0-21swapper/022:10:490
9405992320,2cyclictest16871-21ssh23:46:200
940599230,2cyclictest6240-21idleruntime-cro22:10:010
940599230,2cyclictest27617-21ssh00:26:160
940599230,23cyclictest3466-21diskmemload00:04:500
940599230,23cyclictest0-21swapper/022:17:080
940599230,22cyclictest3466-21diskmemload23:41:320
940599230,22cyclictest3466-21diskmemload21:26:020
940599230,22cyclictest28631-21sh23:57:180
940599230,22cyclictest18551-21ssh22:21:200
940599230,22cyclictest16139-21ssh21:50:040
940599230,22cyclictest0-21swapper/022:48:370
940599230,22cyclictest0-21swapper/000:39:440
940599230,0cyclictest0-21swapper/022:55:450
9412992222,0cyclictest0-21swapper/321:46:363
9412992222,0cyclictest0-21swapper/300:20:133
9412992221,0cyclictest12319-21apt-get19:18:353
9412992221,0cyclictest0-21swapper/323:55:293
9412992220,1cyclictest18936-21ssh22:50:223
9412992220,1cyclictest0-21swapper/320:35:013
941299220,22cyclictest0-21swapper/322:00:353
941299220,22cyclictest0-21swapper/320:03:363
941299220,21cyclictest3466-21diskmemload23:45:213
941299220,21cyclictest3466-21diskmemload22:55:203
941299220,21cyclictest3365-21sh23:05:413
941299220,21cyclictest0-21swapper/323:25:023
941299220,21cyclictest0-21swapper/322:43:543
941299220,21cyclictest0-21swapper/321:35:403
941299220,21cyclictest0-21swapper/320:38:363
941299220,1cyclictest9921-21apt-get19:13:353
941299220,1cyclictest0-21swapper/322:11:403
941299220,0cyclictest0-21swapper/323:04:503
941299220,0cyclictest0-21swapper/320:23:313
940799220,2cyclictest11146-21ssh21:17:272
940799220,21cyclictest6371-21rm00:36:182
940799220,21cyclictest3466-21diskmemload23:55:482
940799220,21cyclictest29944-21ssh23:00:082
940799220,21cyclictest24679-21rm22:55:412
940799220,21cyclictest16959-21ssh21:51:072
940799220,21cyclictest0-21swapper/223:43:372
940799220,21cyclictest0-21swapper/220:33:352
940799220,21cyclictest0-21swapper/220:25:002
940799220,1cyclictest5360-21apt-get23:08:362
940799220,0cyclictest0-21swapper/221:55:152
940799220,0cyclictest0-21swapper/221:21:062
940799220,0cyclictest0-21swapper/221:21:062
9406992222,0cyclictest0-21swapper/123:16:571
9406992222,0cyclictest0-21swapper/122:38:071
9406992222,0cyclictest0-21swapper/121:27:511
9406992222,0cyclictest0-21swapper/100:25:421
9406992221,1cyclictest0-21swapper/122:21:021
9406992220,1cyclictest606-21dbus-daemon20:50:011
9406992220,1cyclictest606-21dbus-daemon19:15:011
9406992220,1cyclictest3498-21dump-pmu-power21:10:001
9406992220,1cyclictest16664-21munin-run19:25:001
9406992220,1cyclictest10064-21munin-run23:40:011
940699220,22cyclictest3466-21diskmemload23:12:551
940699220,21cyclictest0-21swapper/121:15:491
940699220,21cyclictest0-21swapper/120:35:011
940699220,1cyclictest31219-21sh23:02:061
940699220,1cyclictest31106-21sendmail-msp21:00:001
940699220,1cyclictest0-21swapper/123:55:301
940699220,1cyclictest0-21swapper/122:27:011
9405992222,0cyclictest0-21swapper/023:28:200
9405992220,1cyclictest3779-21sh23:06:130
9405992220,1cyclictest0-21swapper/022:00:010
940599220,22cyclictest0-21swapper/022:37:370
940599220,21cyclictest3466-21diskmemload00:15:230
940599220,21cyclictest0-21swapper/019:35:030
940599220,1cyclictest7203-21ssh00:06:290
940599220,1cyclictest29977-21apt-get19:53:410
940599220,1cyclictest2769-21apt-get20:03:360
940599220,1cyclictest11473-21ssh00:12:120
940599220,0cyclictest0-21swapper/023:52:180
940599220,0cyclictest0-21swapper/021:58:590
9412992120,1cyclictest22764-21apt-get19:38:363
9412992120,1cyclictest12204-21ssh22:15:203
9412992119,1cyclictest0-21swapper/319:25:003
941299210,21cyclictest0-21swapper/300:15:213
941299210,20cyclictest17578-21apt-get19:28:363
941299210,20cyclictest0-21swapper/319:48:363
941299210,0cyclictest19975-21apt-get19:33:343
941299210,0cyclictest0-21swapper/321:15:363
941299210,0cyclictest0-21swapper/320:18:353
940799210,21cyclictest0-21swapper/219:38:362
940799210,21cyclictest0-21swapper/200:10:042
940799210,20cyclictest2769-21apt-get20:03:362
940799210,1cyclictest0-21swapper/221:03:362
9406992120,1cyclictest0-21swapper/120:13:421
940699210,21cyclictest0-21swapper/122:55:141
940699210,20cyclictest16648-21apt-get19:25:021
9405992120,1cyclictest29222-21apt-get20:58:360
940599210,21cyclictest0-21swapper/023:00:290
9412992020,0cyclictest0-21swapper/320:28:373
9412992020,0cyclictest0-21swapper/320:13:423
9412992019,1cyclictest26829-21apt-get20:53:363
941299200,0cyclictest0-21swapper/320:48:363
941299200,0cyclictest0-21swapper/319:53:413
941299200,0cyclictest0-21swapper/319:43:353
9407992020,0cyclictest0-21swapper/219:55:022
9407992020,0cyclictest0-21swapper/219:25:012
9407992019,0cyclictest29222-21apt-get20:58:362
9407992018,1cyclictest29452-21munin-run19:50:012
940799200,0cyclictest0-21swapper/219:43:352
940699200,20cyclictest0-21swapper/119:48:361
940699200,19cyclictest24665-21idleruntime-cro19:40:001
9405992020,0cyclictest0-21swapper/019:43:350
9405992020,0cyclictest0-21swapper/019:23:370
9405992018,1cyclictest2233-21munin-run20:00:010
9407991919,0cyclictest0-21swapper/220:43:362
9407991919,0cyclictest0-21swapper/219:13:352
9406991919,0cyclictest0-21swapper/120:03:361
9406991916,2cyclictest28685-21sh20:55:001
9405991919,0cyclictest12377-21apt-get20:23:320
9405991919,0cyclictest0-21swapper/021:08:370
9405991919,0cyclictest0-21swapper/020:43:360
9405991919,0cyclictest0-21swapper/019:33:340
9407991818,0cyclictest0-21swapper/221:08:372
9407991818,0cyclictest0-21swapper/220:18:352
9407991817,1cyclictest0-21swapper/220:48:372
9407991815,2cyclictest21520-21idleruntime-cro20:40:012
9406991818,0cyclictest0-21swapper/120:28:371
9406991818,0cyclictest0-21swapper/120:08:371
9405991817,1cyclictest17270-21apt-get19:25:020
9407991717,0cyclictest0-21swapper/219:18:352
9407991715,1cyclictest28665-21cron20:55:002
9405991716,0cyclictest31641-21apt-get21:03:360
9405991715,1cyclictest19063-21cron20:35:010
940599170,1cyclictest0-21swapper/020:28:370
940599170,0cyclictest0-21swapper/020:18:350
9412991616,0cyclictest0-21swapper/320:43:363
9407991614,1cyclictest313-21systemd-journal20:30:002
9406991614,1cyclictest14154-21cron19:20:001
9406991614,1cyclictest0-21swapper/119:53:461
940599164,11cyclictest313-21systemd-journal19:19:320
9405991616,0cyclictest7566-21apt-get20:13:420
9405991616,0cyclictest0-21swapper/020:08:360
9412991515,0cyclictest0-21swapper/321:03:363
9412991515,0cyclictest0-21swapper/320:08:373
940799150,1cyclictest6861-21grep20:08:482
9405991515,0cyclictest0-21swapper/019:13:350
9412991414,0cyclictest0-21swapper/321:05:093
940799140,14cyclictest0-21swapper/219:30:262
940699140,0cyclictest0-21swapper/120:23:081
940699140,0cyclictest0-21swapper/119:41:301
9405991414,0cyclictest0-21swapper/020:51:490
940599140,14cyclictest0-21swapper/020:37:560
9412991313,0cyclictest0-21swapper/320:58:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional