You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-12 - 10:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Wed Aug 12, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1417973994333,6cyclictest1465222-21cron21:25:012
1417964994333,6cyclictest1504855-21cron23:20:010
1417969994234,5cyclictest1525332-21grep00:20:001
1417975994132,5cyclictest208-21systemd-logind00:38:153
1417975994125,11cyclictest391ktimers/323:40:143
1417973994135,4cyclictest1456670-21cron21:00:012
1417973994135,4cyclictest1456670-21cron21:00:002
1417973994132,6cyclictest0-21swapper/223:25:002
1417973994032,4cyclictest0-21swapper/223:51:202
1417969994029,7cyclictest0-21swapper/120:20:021
1417964994033,4cyclictest1525331-21munin-run00:20:000
1417964994028,8cyclictest1489080-21grep22:30:280
1417975993932,4cyclictest1435810-21sendmail20:00:013
1417973993930,5cyclictest1419909-21cat19:15:022
1417969993931,5cyclictest1490802-21unixbench_singl22:35:261
1417969993931,4cyclictest0-21swapper/120:05:011
1417973993825,10cyclictest311ktimers/200:05:162
1417969993831,4cyclictest1443886-21unixbench_multi20:20:261
141796499383,4cyclictest14619882cat21:15:010
1417975993726,8cyclictest391ktimers/322:10:113
1417973993725,8cyclictest1483714-21grep22:15:262
1417969993727,6cyclictest0-21swapper/121:50:241
1417969993725,8cyclictest0-21swapper/120:10:281
1417975993629,5cyclictest1518514-21munin-run00:00:003
1417975993628,4cyclictest0-21swapper/300:11:263
1417973993629,4cyclictest1492931-21cron22:45:012
1417969993629,4cyclictest0-21swapper/119:50:011
1417969993625,7cyclictest0-21swapper/123:50:251
1417969993624,8cyclictest1504853-21cron23:20:001
1417964993629,4cyclictest1532404-21cut00:40:010
1417973993528,4cyclictest1498517-21fschecks_time23:00:152
1417973993527,4cyclictest0-21swapper/219:30:312
1417973993525,6cyclictest0-21swapper/219:45:012
1417973993525,6cyclictest0-21swapper/219:45:002
1417973993525,6cyclictest0-21swapper/219:15:262
1417973993525,6cyclictest0-21swapper/200:25:272
1417969993527,4cyclictest0-21swapper/121:25:181
1417969993527,4cyclictest0-21swapper/120:55:181
1417969993527,4cyclictest0-21swapper/120:55:171
1417969993526,5cyclictest0-21swapper/123:40:271
1417964993527,4cyclictest0-21swapper/020:25:010
1417964993524,7cyclictest1487343-21grep22:25:230
1417964993524,6cyclictest0-21swapper/000:00:270
1417964993524,6cyclictest0-21swapper/000:00:270
1417975993427,4cyclictest1446218-21latency_hist20:30:023
1417975993426,4cyclictest0-21swapper/319:20:013
1417973993426,5cyclictest0-21swapper/200:05:002
1417973993426,5cyclictest0-21swapper/200:05:002
1417973993410,4cyclictest1487363-21grep22:25:232
1417969993427,4cyclictest1473749-21auditctl21:50:001
1417969993426,4cyclictest0-21swapper/122:00:001
1417969993426,4cyclictest0-21swapper/119:40:001
1417969993425,6cyclictest0-21swapper/120:55:011
141796499343,8cyclictest131rcu_preempt20:45:130
1417964993427,4cyclictest13550irq/42-30be0000.ethernet20:25:130
1417964993424,6cyclictest0-21swapper/023:20:240
1417964993424,4cyclictest0-21swapper/020:55:010
1417975993325,5cyclictest1431926-21unixbench_multi19:45:253
1417975993323,6cyclictest1483701-21grep22:15:263
1417973993327,4cyclictest1511686-21sh23:40:002
1417973993327,4cyclictest1460098-21cron21:10:002
1417973993324,6cyclictest1473347-21unixbench_singl21:45:262
1417973993324,6cyclictest1443006-21fschecks_count20:20:162
1417973993323,6cyclictest0-21swapper/220:40:232
1417973993323,6cyclictest0-21swapper/219:30:012
1417969993324,6cyclictest0-21swapper/121:15:011
1417969993324,6cyclictest0-21swapper/120:50:011
1417969993321,9cyclictest1531892-21grep00:35:261
1417964993326,4cyclictest1484208-21sendmail22:20:000
1417964993323,5cyclictest13550irq/42-30be0000.ethernet23:00:000
1417975993225,5cyclictest1439122-21kworker/u8:0+events_unbound20:30:403
1417975993225,5cyclictest1439122-21kworker/u8:0+events_unbound20:30:403
1417973993225,3cyclictest0-21swapper/222:15:012
1417973993221,8cyclictest1513402-21audit_send_reply23:45:002
1417973993221,6cyclictest0-21swapper/222:10:002
1417969993224,4cyclictest0-21swapper/123:25:251
1417969993223,6cyclictest0-21swapper/121:45:001
1417969993223,6cyclictest0-21swapper/100:20:261
1417969993223,5cyclictest1447476-21tail20:30:261
1417969993223,5cyclictest1447476-21tail20:30:261
1417969993222,7cyclictest0-21swapper/121:05:281
1417969993222,6cyclictest1530230-21grep00:30:261
1417969993220,7cyclictest0-21swapper/122:40:241
1417964993224,4cyclictest0-21swapper/000:20:260
1417964993219,8cyclictest0-21swapper/021:25:260
1417975993125,3cyclictest0-21swapper/321:10:013
1417975993120,8cyclictest391ktimers/320:55:063
1417975993120,8cyclictest391ktimers/320:55:063
1417973993124,4cyclictest0-21swapper/223:25:262
1417973993121,7cyclictest0-21swapper/223:05:282
1417973993121,6cyclictest0-21swapper/200:14:592
1417969993122,6cyclictest1511679-21sh23:40:011
1417969993121,6cyclictest0-21swapper/123:45:271
1417969993121,6cyclictest0-21swapper/119:30:011
1417964993125,3cyclictest1518513-21sh00:00:000
1417964993124,4cyclictest0-21swapper/023:40:000
141796499312,12cyclictest1464764-21grep21:20:280
1417964993120,7cyclictest1430264-21grep19:40:260
1417964993120,7cyclictest1430264-21grep19:40:260
1417964993120,7cyclictest1424912-21grep19:25:260
1417964993120,6cyclictest0-21swapper/019:15:260
1417975993023,4cyclictest0-21swapper/300:20:263
1417975993022,4cyclictest0-21swapper/320:35:283
1417975993014,13cyclictest1417962-21cyclictest20:50:123
1417975993010,4cyclictest14688012latency_hist21:35:013
1417973993024,3cyclictest0-21swapper/222:35:002
1417973993021,6cyclictest0-21swapper/222:25:002
1417973993020,6cyclictest0-21swapper/223:30:252
1417973993020,6cyclictest0-21swapper/220:05:332
1417969993023,4cyclictest0-21swapper/121:35:161
1417969993022,5cyclictest0-21swapper/121:35:001
1417969993021,6cyclictest0-21swapper/100:25:181
1417969993016,9cyclictest204-21dbus-daemon23:56:211
141796499304,5cyclictest131rcu_preempt19:45:120
1417964993022,4cyclictest0-21swapper/022:10:260
1417964993020,6cyclictest0-21swapper/020:15:270
1417964993019,6cyclictest1500986-21grep23:05:280
1417975992923,4cyclictest1470286-21kworker/u8:1+events_unbound21:46:103
1417975992923,3cyclictest0-21swapper/323:35:003
1417975992921,4cyclictest0-21swapper/321:35:173
1417973992921,4cyclictest0-21swapper/221:25:172
1417973992921,4cyclictest0-21swapper/219:55:342
1417973992920,6cyclictest0-21swapper/220:50:012
1417973992919,6cyclictest0-21swapper/221:30:272
1417969992920,6cyclictest1509975-21sh23:35:001
1417969992920,5cyclictest1443988-21kworker/u8:2+events_unbound20:25:271
1417969992919,6cyclictest1-21systemd21:20:491
1417964992923,4cyclictest1417587-21kworker/u8:1+events_unbound19:10:290
1417964992923,3cyclictest0-21swapper/020:45:010
1417964992922,4cyclictest0-21swapper/022:25:000
1417964992918,8cyclictest1530240-21grep00:30:260
1417964992918,7cyclictest0-21swapper/022:40:240
1417975992821,4cyclictest0-21swapper/322:05:253
1417975992818,7cyclictest0-21swapper/319:30:013
1417973992821,3cyclictest0-21swapper/222:35:162
1417973992820,5cyclictest0-21swapper/223:15:002
1417973992820,4cyclictest0-21swapper/220:10:272
1417973992819,6cyclictest0-21swapper/221:45:002
1417973992819,5cyclictest0-21swapper/221:55:262
1417973992819,5cyclictest0-21swapper/221:35:262
1417969992819,6cyclictest0-21swapper/123:20:241
1417969992819,6cyclictest0-21swapper/122:05:251
1417969992819,6cyclictest0-21swapper/100:10:001
1417969992818,6cyclictest0-21swapper/119:55:271
1417964992822,3cyclictest0-21swapper/023:50:160
1417964992818,6cyclictest1471645-21grep21:40:260
1417964992813,9cyclictest1528498-21unixbench_multi00:25:260
1417975992721,3cyclictest1439212-21kthreadd20:10:013
1417975992718,5cyclictest0-21swapper/319:50:143
1417973992721,3cyclictest0-21swapper/220:40:002
1417969992719,5cyclictest0-21swapper/120:05:241
1417969992719,4cyclictest0-21swapper/120:40:141
1417969992718,6cyclictest0-21swapper/119:40:271
1417969992718,6cyclictest0-21swapper/119:40:261
1417969992716,7cyclictest0-21swapper/122:30:001
141796499272,18cyclictest1513412-21grep23:45:000
1417964992719,4cyclictest0-21swapper/023:00:230
1417964992719,4cyclictest0-21swapper/020:55:170
1417964992719,4cyclictest0-21swapper/020:55:170
1417964992718,6cyclictest1426796-21grep19:30:250
1417964992718,6cyclictest0-21swapper/020:05:330
1417964992717,7cyclictest1515100-21sh23:50:010
1417964992716,7cyclictest1477604-21grep22:00:180
1417964992710,12cyclictest1423186-21tail19:20:260
1417975992620,3cyclictest0-21swapper/323:00:203
1417975992619,5cyclictest178-21systemd-udevd22:54:403
1417975992619,4cyclictest0-21swapper/321:10:283
1417975992618,4cyclictest0-21swapper/322:30:273
1417975992618,4cyclictest0-21swapper/300:31:273
1417975992617,6cyclictest0-21swapper/319:15:023
1417973992619,3cyclictest0-21swapper/223:55:292
1417973992615,7cyclictest0-21swapper/200:35:272
141797399261,4cyclictest0-21swapper/221:16:212
1417973992610,5cyclictest14619882cat21:15:012
1417969992618,6cyclictest1473593-21kworker/u8:2+events_unbound22:15:021
1417969992618,5cyclictest1494640-21munin-plugin-st22:50:011
1417969992618,5cyclictest1494640-21munin-plugin-st22:50:001
1417969992617,6cyclictest0-21swapper/122:55:001
1417969992617,5cyclictest0-21swapper/122:15:001
1417969992616,7cyclictest0-21swapper/119:15:011
1417964992621,3cyclictest1503254-21latency_hist23:15:010
1417964992621,3cyclictest1494738-21latency_hist22:50:000
1417964992621,3cyclictest1494738-21latency_hist22:50:000
1417964992621,3cyclictest1448028-21latency_hist20:35:000
1417964992621,3cyclictest1448028-21latency_hist20:35:000
1417964992620,4cyclictest1452884-21kworker/u8:0+events_unbound21:00:470
1417964992618,4cyclictest0-21swapper/021:15:260
141796499261,3cyclictest131rcu_preempt19:55:140
1417975992519,4cyclictest1454599-21kworker/u8:2+events_unbound21:01:273
1417975992518,5cyclictest208-21systemd-logind20:24:403
1417975992515,8cyclictest1423257-21users19:20:273
1417973992520,2cyclictest0-21swapper/200:20:242
1417973992518,4cyclictest0-21swapper/223:15:252
1417973992517,5cyclictest0-21swapper/222:05:002
1417973992517,4cyclictest0-21swapper/222:55:152
1417973992516,6cyclictest1423655-21basename19:25:012
1417973992515,7cyclictest1524922-21grep00:15:282
1417973992513,9cyclictest1454765-21auditctl20:55:012
1417969992515,7cyclictest1501669-21sed23:10:021
1417969992515,7cyclictest1432719-21df19:50:121
1417969992515,6cyclictest0-21swapper/123:00:221
1417969992515,6cyclictest0-21swapper/121:15:261
1417964992521,2cyclictest13550irq/42-30be0000.ethernet00:05:160
1417964992517,5cyclictest0-21swapper/021:40:000
141796499251,20cyclictest1523219-21grep00:10:250
141796499251,20cyclictest1468207-21head21:30:270
141796499251,20cyclictest0-21swapper/023:27:350
1417964992510,9cyclictest204-21dbus-daemon19:50:350
1417975992418,3cyclictest0-21swapper/320:40:183
1417975992417,3cyclictest0-21swapper/323:10:143
1417975992416,5cyclictest0-21swapper/323:00:003
1417975992416,4cyclictest1470740-21fschecks_count21:40:163
1417975992414,6cyclictest0-21swapper/300:05:283
1417964992417,3cyclictest0-21swapper/022:40:000
1417964992416,6cyclictest121ktimers/020:00:170
1417964992416,4cyclictest0-21swapper/019:35:160
1417964992415,6cyclictest121ktimers/021:05:250
141796499241,20cyclictest438-21cron22:55:010
141796499241,19cyclictest0-21swapper/021:53:040
1417975992317,4cyclictest164-21systemd-journal21:24:403
1417975992317,3cyclictest1525071-21sh00:17:003
1417975992317,3cyclictest0-21swapper/323:50:193
1417975992317,3cyclictest0-21swapper/323:15:173
1417975992316,5cyclictest178-21systemd-udevd20:14:403
1417975992316,3cyclictest0-21swapper/322:00:183
1417975992315,5cyclictest1463540-21idleruntime-cro21:20:013
1417975992315,5cyclictest0-21swapper/323:35:153
1417975992312,8cyclictest1475900-21cut21:55:163
1417973992317,3cyclictest0-21swapper/222:45:152
1417973992317,3cyclictest0-21swapper/222:45:152
1417973992315,5cyclictest0-21swapper/219:50:142
141796999231,9cyclictest0-21swapper/123:00:001
1417969992316,5cyclictest1420446-21kworker/u8:3+events_unbound19:19:071
1417969992316,4cyclictest1427262-21sh19:35:001
1417969992315,5cyclictest0-21swapper/121:00:251
141796499233,4cyclictest131rcu_preempt21:45:110
1417964992316,3cyclictest0-21swapper/020:35:450
1417964992315,4cyclictest1477269-21latency_hist22:00:010
1417975992216,4cyclictest0-21swapper/319:30:263
1417975992216,3cyclictest0-21swapper/323:05:173
1417975992216,3cyclictest0-21swapper/319:35:163
1417975992215,5cyclictest178-21systemd-udevd20:02:403
1417975992213,6cyclictest0-21swapper/320:20:013
1417973992216,3cyclictest0-21swapper/221:50:122
1417973992215,3cyclictest0-21swapper/220:15:262
1417973992214,5cyclictest0-21swapper/223:45:272
1417973992214,5cyclictest0-21swapper/200:31:272
1417973992213,6cyclictest0-21swapper/220:25:172
1417973992212,6cyclictest0-21swapper/221:00:222
1417969992215,4cyclictest0-21swapper/122:20:261
1417964992215,3cyclictest0-21swapper/023:32:060
141796499221,19cyclictest0-21swapper/022:05:550
141796499221,18cyclictest0-21swapper/020:12:120
141797599219,8cyclictest391ktimers/322:40:103
1417975992115,3cyclictest0-21swapper/320:45:233
1417975992113,5cyclictest0-21swapper/322:25:003
1417975992111,7cyclictest1466033-21ntp_states21:25:233
1417973992115,3cyclictest0-21swapper/220:30:222
1417973992115,3cyclictest0-21swapper/220:30:212
1417969992115,3cyclictest0-21swapper/100:10:251
1417969992110,8cyclictest1518869-21df_inode00:00:161
1417969992110,8cyclictest1518869-21df_inode00:00:151
141797599206,3cyclictest6250watchdogd19:40:223
141797599206,3cyclictest6250watchdogd19:40:223
1417975992011,6cyclictest1493734-21ntp_states22:45:203
1417975992011,6cyclictest1493734-21ntp_states22:45:203
1417975992010,7cyclictest1487978-21date22:30:013
1417973992014,3cyclictest0-21swapper/220:00:282
1417969992013,4cyclictest0-21swapper/122:00:171
1417969992012,5cyclictest231ktimers/119:20:211
141797599198,3cyclictest131rcu_preempt22:35:173
1417975991914,3cyclictest645-21runrttasks21:50:203
1417975991913,4cyclictest1527806-21if_eth100:25:193
1417975991913,3cyclictest0-21swapper/323:25:163
1417975991912,5cyclictest391ktimers/323:45:163
1417975991910,6cyclictest1519328-21ntpq00:00:223
1417975991910,6cyclictest1519328-21ntpq00:00:223
1417973991910,5cyclictest0-21swapper/219:45:252
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional